Robots.txt Generator
Create custom robots.txt files to control search engine crawling — works offline.
Select Bots:
Googlebot
Bingbot
Yandex Bot
Yahoo! Slurp
DuckDuckGo
Baidu Spider
All Other Crawlers
Crawl Delay (seconds):
Disallowed Paths (one per line)
/admin\n/private
Generate robots.txt
Your robots.txt will appear here after generating.
Copy robots.txt
Download File
Clear Output