cheapshark.com
robots.txt

Robots Exclusion Standard data for cheapshark.com

Resource Scan

Scan Details

Site Domain cheapshark.com
Base Domain cheapshark.com
Scan Status Ok
Last Scan2025-04-09T04:41:25+00:00
Next Scan 2025-04-16T04:41:25+00:00

Last Scan

Scanned2025-04-09T04:41:25+00:00
URL https://cheapshark.com/robots.txt
Redirect https://www.cheapshark.com/robots.txt
Redirect Domain www.cheapshark.com
Redirect Base cheapshark.com
Domain IPs 172.66.40.111, 172.66.43.145, 2606:4700:3108::ac42:286f, 2606:4700:3108::ac42:2b91
Redirect IPs 172.66.40.111, 172.66.43.145, 2606:4700:3108::ac42:286f, 2606:4700:3108::ac42:2b91
Response IP 172.66.43.145
Found Yes
Hash a0db90b87dc15d52b77826ef79586dbf2c5938a596d256194b45db5e84661b4e
SimHash 61101c52abda

Groups

*

Rule Path
Disallow
Disallow /admin/
Disallow /send
Disallow /cdn-cgi/
Disallow /search?q
Disallow /pc_releases
Disallow /privacy
Disallow /terms

Other Records

Field Value
sitemap https://www.cheapshark.com/sitemap.xml

Comments

  • search sub-pages, duplicate content hit
  • calendar
  • policy