dogfrench.ru
robots.txt

Robots Exclusion Standard data for dogfrench.ru

Resource Scan

Scan Details

Site Domain dogfrench.ru
Base Domain dogfrench.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan5/19/2025, 2:55:15 AM
Next Scan 5/26/2025, 2:55:15 AM

Last Successful Scan

Scanned4/18/2025, 2:37:43 AM
URL https://dogfrench.ru/robots.txt
Domain IPs 104.21.71.160, 172.67.147.63, 2606:4700:3032::ac43:933f, 2606:4700:3035::6815:47a0
Response IP 172.67.147.63
Found Yes
Hash 9f8584560ecb7d008e1afdcacb61047169b1d022ad287e3f71fea95bda7eb982
SimHash 67008c434590

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://dogfrench.ru/sitemap.xml

Warnings

  • `host` is not a known field.