canfosses.com
robots.txt

Robots Exclusion Standard data for canfosses.com

Resource Scan

Scan Details

Site Domain canfosses.com
Base Domain canfosses.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-25T08:47:41+00:00
Next Scan 2026-01-23T08:47:41+00:00

Last Successful Scan

Scanned2025-06-04T16:40:24+00:00
URL https://canfosses.com/robots.txt
Domain IPs 104.21.84.43, 172.67.186.24, 2606:4700:3034::6815:542b, 2606:4700:3037::ac43:ba18
Response IP 172.67.186.24
Found Yes
Hash 4054601403da390ff959325768c179a73ec8618a6e820e859b2506b0b1832fcc
SimHash 2819d810e3f0

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 300

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 300