autocenter-66.ru
robots.txt

Robots Exclusion Standard data for autocenter-66.ru

Resource Scan

Scan Details

Site Domain autocenter-66.ru
Base Domain autocenter-66.ru
Scan Status Ok
Last Scan2025-04-14T11:36:05+00:00
Next Scan 2025-05-14T11:36:05+00:00

Last Scan

Scanned2025-04-14T11:36:05+00:00
URL https://autocenter-66.ru/robots.txt
Domain IPs 104.21.35.38, 172.67.213.42, 2606:4700:3033::6815:2326, 2606:4700:3033::ac43:d52a
Response IP 104.21.35.38
Found Yes
Hash 02cc81fe181346c3101a83a42c7c5dfd421a2d674888eed612d9ca46921988f8
SimHash 63009cc3c4b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://autocenter-66.ru/sitemap.xml

Warnings

  • `host` is not a known field.