開発者向けすぐに利用できます

Robots.txt Generator

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

TODO-i18n: this tool's instructions and FAQs are currently available in English.

ツール操作エリア

アカウント不要

Inputs and generated outputs stay in this browser. Files and secrets are not uploaded to SiteIndex.

Rules (one per line)Sitemap URL (optional)

Robots.txt Generatorとは

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

使い方

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

よくある用途

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

利用上の注意

Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.

よくある質問

Robots.txt Generatorとは: Build a robots.txt file with user-agent, allow, disallow, crawl-delay, and sitemap rules, then download it locally.