robot-tsr.ru
robots.txt

Robots Exclusion Standard data for robot-tsr.ru

Resource Scan

Scan Details

Site Domain robot-tsr.ru
Base Domain robot-tsr.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-25T18:18:10+00:00
Next Scan 2025-11-23T18:18:10+00:00

Last Successful Scan

Scanned2025-04-05T04:07:26+00:00
URL https://robot-tsr.ru/robots.txt
Domain IPs 104.21.13.51, 172.67.132.155, 2606:4700:3031::ac43:849b, 2606:4700:3037::6815:d33
Response IP 104.21.13.51
Found Yes
Hash 13840ae6a443443fdcdfd8590445388a46e78a3bbc4ef7010d6a1958ccf51151
SimHash 67009c53cdb1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://robot-tsr.ru/sitemap.xml

Warnings

  • `host` is not a known field.