SEO Suite

robots.txt Challenge

Analyze disallow structures, user-agent specific scopes, sitemaps syntax, and specificity patterns to audit crawl access rules.

Progress1 of 4 (25%)
robots.txt Syntaxeasy

Under these robots rules, is a search engine crawler allowed to crawl the path 'https://rajesh.com/admin/settings'?

robots.txt
User-agent: *
Disallow: /admin/
Allow: /admin/login