Robots.txt Generator

Generate robots.txt files with user-agent rules, sitemap references, and crawl-delay directives

All processing happens in your browser. No data is uploaded.

Offline Ready

Generate robots.txt files with user-agent rules, sitemap references, and crawl-delay directives

🔒All processing happens in your browser. No data is uploaded.

Presets

Rule Group #1

User-Agent

* (All bots)

Disallow Paths

/path/to/disallow/

Allow Paths

Crawl Delay

Sitemap URLs

https://example.com/sitemap.xml

Host Directive

www.example.com

Generated robots.txt

robots.txt

User-agent: *
Disallow: