Private, browser-local utility

Robots.txt Generator

Generate bounded robots.txt text from user-agent, Allow, Disallow, and Sitemap controls.

Rules are generated locally. Nothing is uploaded or applied to a website.

robots.txt controls crawler access, not guaranteed indexing or removal. Incorrect rules can block important content. Review the output before publishing.

User-agent(s), one per lineAllow paths, one per lineDisallow paths, one per lineSitemap URL(s), one per line

Loading local tool…

Generated robots.txt

Supported directives and safety boundary

V1 emits User-agent, Allow, Disallow, and Sitemap only. One bounded rule group is exposed in the interface; the core supports up to eight groups for verified future extension. Empty rule lists emit Disallow: to allow crawling.

Every input line rejects embedded newlines and control characters after bounded line splitting. Paths must begin with /. Sitemap URLs must be credential-free HTTP or HTTPS URLs without fragments. Crawlers may interpret directives differently. This is not a live checker, meta-robots tool, sitemap generator, security control, or automatic publisher.