Indexation

Robots.txt Checker

Enter any domain and we'll fetch/robots.txtfrom its root, parse every user-agent group and sitemap declaration, and flag the dangerous Disallow: / case.