taganrog.cf
robots.txt

Robots Exclusion Standard data for taganrog.cf

Resource Scan

Scan Details

Site Domain taganrog.cf
Base Domain taganrog.cf
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-28T02:01:02+00:00
Next Scan 2025-08-26T02:01:02+00:00

Last Successful Scan

Scanned2024-01-11T19:21:00+00:00
URL https://taganrog.cf/robots.txt
Domain IPs 104.21.75.54, 172.67.214.210, 2606:4700:3033::ac43:d6d2, 2606:4700:3034::6815:4b36
Response IP 104.21.75.54
Found Yes
Hash 436b9d94a490a212399b1bb9b51a09d4ece119db7d690d507b38a23b1d1484ee
SimHash 6518d072c331

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5