robots.txt and sitemap.xml analyzer robots.txt and sitemap.xml analyzer

Analyze robots.txt and sitemap.xml online

Enter a website URL to fetch robots.txt, parse crawler groups, detect Sitemap directives and validate linked sitemap XML files.

The analyzer checks whether important bots can crawl the root path, counts sitemap URLs, finds duplicate or external URLs and performs a sampled broken-link check for sitemap entries.

The tool runs directly in the browser and is ready for quick checks without installing software.
Input can be cleared and recalculated immediately, which is useful for repeated small tasks.
Use fullscreen mode when you need more space for long text, structured data or large result blocks.
Copy buttons are available on generated output so results can be reused in code, documents or support chats.
Most operations are deterministic: the same input and options produce the same output.
For sensitive content, prefer local browser tools and review the result before sharing it further.