grdelo.ru
robots.txt

Robots Exclusion Standard data for grdelo.ru

Resource Scan

Scan Details

Site Domain grdelo.ru
Base Domain grdelo.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-29T04:25:10+00:00
Next Scan 2025-01-27T04:25:10+00:00

Last Successful Scan

Scanned2023-12-11T23:28:35+00:00
URL https://grdelo.ru/robots.txt
Domain IPs 104.21.20.43, 172.67.191.84, 2606:4700:3030::ac43:bf54, 2606:4700:3037::6815:142b
Response IP 172.67.191.84
Found Yes
Hash 9e0cb7c15a3bd37ad504620202b46ccff1660bfa1613947bfc1c7bdc2bea18fe
SimHash 67088cc3ccb1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://grdelo.ru/sitemap.xml

Warnings

  • `host` is not a known field.