Log In Sign Up

cheaterscanner.com
robots.txt

Robots Exclusion Standard data for cheaterscanner.com

Resource Scan

Scan Details

Site Domain cheaterscanner.com
Base Domain cheaterscanner.com
Scan Status Ok
Last Scan2025-08-16T03:51:07+00:00
Next Scan 2025-09-15T03:51:07+00:00

Last Scan

Scanned2025-08-16T03:51:07+00:00
URL https://cheaterscanner.com/robots.txt
Redirect https://www.cheaterscanner.com/robots.txt
Redirect Domain www.cheaterscanner.com
Redirect Base cheaterscanner.com
Domain IPs 216.150.1.1
Redirect IPs 216.150.1.1, 216.150.16.1
Response IP 216.150.1.1
Found Yes
Hash d6270020e9488de5b6fd9bef9011a57df92bd26bf762acb536956951376b39f7
SimHash 08715bf0e817

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

ccbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claude-web

Rule Path
Allow /

omgilibot

Rule Path
Allow /

applebot

Rule Path
Allow /
Disallow /_next/static/
Disallow /_next/image/
Disallow /.next/
Disallow /api/
Disallow /subscription
Allow /static/
Allow /images/
Allow /media/
Allow /assets/
Disallow /dev/
Disallow /staging/
Disallow /test/
Back to top

Other Records

Field Value
sitemap https://www.cheaterscanner.com/sitemap.xml
Back to top

Comments

  • Allow all crawlers including AI crawlers
  • Explicitly allow AI crawlers
  • Sitemap location
  • Prevent crawling of next.js specific files
  • Block subscription page
  • Allow crawling of static assets
  • Block common development paths
Back to top