Krew Tools
Home
Back
Robots.txt Generator
Build a robots.txt file to control how search engine bots crawl your site.
User-Agent
Allowed Paths (one per line)
Disallowed Paths (one per line)
Sitemap URL
Generate
Copy
Download robots.txt
Generated locally in your browser.