csfail.us
robots.txt

Robots Exclusion Standard data for csfail.us

Resource Scan

Scan Details

Site Domain csfail.us
Base Domain csfail.us
Scan Status Ok
Last Scan2025-06-01T06:17:17+00:00
Next Scan 2025-06-15T06:17:17+00:00

Last Scan

Scanned2025-06-01T06:17:17+00:00
URL https://csfail.us/robots.txt
Domain IPs 104.26.4.203, 104.26.5.203, 172.67.74.68
Response IP 104.26.5.203
Found Yes
Hash 7159096df919c847cd61db1315d9f229629b0436e508aaa82b021ea645b72814
SimHash 6164573067b3

Groups

*

Rule Path
Disallow /r/
Disallow /404
Disallow /not-logged

Comments

  • www.robotstxt.org/
  • Allow crawling of all content