robots.txt Generator

Build a clean robots.txt from user-agents, allow/disallow rules and sitemaps.

Quick presets

Groups Sitemap URLs (one per line)

robots.txt

0 user-agent group(s) · 0 rule(s) · 0 sitemap(s)

About this tool

Add as many user-agent groups as you need, list allow / disallow paths and sitemap URLs, and copy the generated robots.txt straight to your site root.