csfail.com
robots.txt

Robots Exclusion Standard data for csfail.com

Resource Scan

Scan Details

Site Domain csfail.com
Base Domain csfail.com
Scan Status Ok
Last Scan2024-06-01T07:34:25+00:00
Next Scan 2024-07-01T07:34:25+00:00

Last Scan

Scanned2024-06-01T07:34:25+00:00
URL https://csfail.com/robots.txt
Redirect https://3cs.fail/robots.txt
Redirect Domain 3cs.fail
Redirect Base 3cs.fail
Domain IPs 104.26.6.182, 104.26.7.182, 172.67.73.238
Redirect IPs 104.26.12.75, 104.26.13.75, 172.67.71.1
Response IP 172.67.71.1
Found Yes
Hash 7159096df919c847cd61db1315d9f229629b0436e508aaa82b021ea645b72814
SimHash 6164573067b3

Groups

*

Rule Path
Disallow /r/
Disallow /404
Disallow /not-logged

Comments

  • www.robotstxt.org/
  • Allow crawling of all content