Home
chevron_right
Dev Tools
chevron_right
robots.txt Tester
smart_toy
robots.txt Tester
Test if a URL is allowed or blocked by a robots.txt file.
robots.txt Content
User-agent: * Disallow: /admin/ Disallow: /private/ Allow: /public/ Sitemap: https://example.com/sitemap.xml
User-Agent
URL Path to Test
play_arrow
Test URL
Bulk Test URLs (one per line)
Test All URLs