Files never leave your device

robots.txt Generator

Generate a properly-formatted robots.txt. Add user-agent rules, allow/disallow paths, link your sitemap, and copy the result.

How to use robots.txt Generator

  1. Add one block per user-agent.
  2. List allow/disallow paths — one per line.
  3. Optionally point to your sitemap and copy the result to /robots.txt on your server.

Frequently asked questions