Loading...
Website tools

Robots.txt Generator

Build a basic robots.txt with allow/disallow rules and optional sitemap URL.

Inputs
Result preview

Waiting for input

Fill the form and calculate — results show here instantly.

Need this in your website, CRM, or app?

More Website

About this Robots.txt Generator

Build a simple robots.txt with allow/disallow rules and an optional sitemap line.

How to use

  1. Choose allow-all or block-all default.
  2. Add disallow paths one per line if needed.
  3. Add sitemap URL when available.
  4. Copy output to your site root as robots.txt.

Example

Example: Allow all crawlers but disallow /admin and include Sitemap: https://example.com/sitemap.xml.