DesarrolloLista para usar

Robots.txt Generator

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

TODO-i18n: this tool's instructions and FAQs are currently available in English.

Área de trabajo interactiva

No necesitas una cuenta

Inputs and generated outputs stay in this browser. Files and secrets are not uploaded to SiteIndex.

Rules (one per line)Sitemap URL (optional)

¿Qué es Robots.txt Generator?

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Cómo funciona

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Usos habituales

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Limitaciones

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Preguntas frecuentes

¿Qué es Robots.txt Generator?: Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.