← All free tools

robots.txt builder for local sites

Build a robots.txt that lets the right crawlers in (Google, Bing, AI search) and keeps the wrong ones out.

Pick the crawlers you want, the paths you don't, and download a clean robots.txt. Includes the AI-search bots most generators forget (GPTBot, PerplexityBot, ClaudeBot).

Or start a 7-day free trial of Mani →
Allow these crawlers
# Output will appear here
When you're ready to turn the visitors who use these tools into captured leads on your own site:
Start your 7-day free trial — $20/mo, no card