supercheats.com
robots.txt

Robots Exclusion Standard data for supercheats.com

Resource Scan

Scan Details

Site Domain supercheats.com
Base Domain supercheats.com
Scan Status Ok
Last Scan2024-11-09T18:46:09+00:00
Next Scan 2024-11-16T18:46:09+00:00

Last Scan

Scanned2024-11-09T18:46:09+00:00
URL https://supercheats.com/robots.txt
Redirect https://www.supercheats.com/robots.txt
Redirect Domain www.supercheats.com
Redirect Base supercheats.com
Domain IPs 104.25.225.112, 104.25.226.112, 172.67.97.179, 2606:4700:20::6819:e170, 2606:4700:20::6819:e270, 2606:4700:20::ac43:61b3
Redirect IPs 104.25.225.112, 104.25.226.112, 172.67.97.179, 2606:4700:20::6819:e170, 2606:4700:20::6819:e270, 2606:4700:20::ac43:61b3
Response IP 104.25.225.112
Found Yes
Hash a6f5e96567826bee487d3781448bd3ac71f36c02915e0c9d06bddb10e8e1ebf7
SimHash e5306a222f97

Groups

*

Rule Path
Allow /
Disallow /highslide
Disallow /wiki/*?history=
Disallow /supercheats-test.htm
Disallow /*/*/0/not-found
Disallow /*/*/0/ar-codes/not-found
Disallow /*/.htm
Disallow /latestforums/pages/*
Disallow /newpage/*
Disallow /avatar.php
Disallow /search.php
Disallow /bio.php
Disallow /editdetails.php
Disallow /ratesubmission.php
Disallow /*/addfriendcodebox
Disallow /*/reportcomment
Disallow /*/ratingbox
Disallow /*/reportquestion
Disallow /*/reportanswer
Disallow /*/commentanswer
Disallow /sitetest
Disallow /pokemontest
Disallow /supercheats-test*

anthropic-ai
claude-web
ccbot
facebookbot
gptbot
piplbot

Rule Path
Disallow /