⚡

Robots.txt Generator

Generate a custom robots.txt file for your website to control crawler access.

Crawler Rules

User-agent:

Allow

Disallow

Sitemap URL (optional)

robots.txt

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /private/