DéveloppementPrêt à l’emploi

Robots.txt Generator

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

TODO-i18n: this tool's instructions and FAQs are currently available in English.

Espace de travail interactif

Aucun compte requis

Inputs and generated outputs stay in this browser. Files and secrets are not uploaded to SiteIndex.

Rules (one per line)Sitemap URL (optional)

Qu’est-ce que Robots.txt Generator ?

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Fonctionnement

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Utilisations courantes

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Limites

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

Questions fréquentes

Qu’est-ce que Robots.txt Generator ?: Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.