← All text tools

Robots.txt generator

Create a robots.txt: allow or block folders, add your sitemap, and block AI crawlers in one click.

  • Free
  • No sign-up
  • Works on any device

About Robots.txt generator

Builds a robots.txt file where you allow or block folders for crawlers, add your sitemap address and block known AI crawlers with one click. The file must live at the root of the domain. Remember that robots.txt asks bots to stay away, but it does not hide private pages.

How to use Robots.txt generator

  1. Set the options above. The result updates live.
  2. Change anything until it's just right.
  3. Copy the result or download it.

Why use this tool?

Also known as

Frequently asked questions

Does robots.txt keep a page out of Google?

Not reliably. Blocked pages can still be listed if linked elsewhere. Use a noindex tag or password protection to keep a page out of results.

Is Robots.txt generator free?

Yes. Robots.txt generator on Toolipedia is free to use, with no sign-up and no watermark.

Is it safe to use?

Yes. Everything is worked out in your browser, and nothing you enter is sent to our server.

Does it work on my phone?

Yes. It works in any modern browser on Android and iPhone, as well as on tablets and computers. There's nothing to install.

Do I need an account?

No. Just open the page and use the tool. There's no sign-up and no email needed.

Related tools