DesenvolvimentoPronta para usar

Robots.txt Generator

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

TODO-i18n: this tool's instructions and FAQs are currently available in English.

Área de trabalho interativa

Não precisa de conta

Inputs and generated outputs stay in this browser. Files and secrets are not uploaded to SiteIndex.

Rules (one per line)Sitemap URL (optional)

O que é Robots.txt Generator?

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Como funciona

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Usos comuns

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Limitações

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Perguntas frequentes

O que é Robots.txt Generator?: Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.