SEO Suite
robots.txt Challenge
Analyze disallow structures, user-agent specific scopes, sitemaps syntax, and specificity patterns to audit crawl access rules.
Progress1 of 4 (25%)
robots.txt Syntaxeasy
Under these robots rules, is a search engine crawler allowed to crawl the path 'https://rajesh.com/admin/settings'?
robots.txt
User-agent: *
Disallow: /admin/
Allow: /admin/login