hdlenta.ru
robots.txt

Robots Exclusion Standard data for hdlenta.ru

Resource Scan

Scan Details

Site Domain hdlenta.ru
Base Domain hdlenta.ru
Scan Status Ok
Last Scan2025-10-12T04:33:13+00:00
Next Scan 2025-10-19T04:33:13+00:00

Last Scan

Scanned2025-10-12T04:33:13+00:00
URL https://hdlenta.ru/robots.txt
Domain IPs 104.21.67.16, 172.67.167.157, 2606:4700:3034::6815:4310, 2606:4700:3037::ac43:a79d
Response IP 172.67.167.157
Found Yes
Hash 01f4e05757e8cd0959270907b7388abf8361f01b515185bcf22df203bae4e9ce
SimHash 63009c434db1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://hdlenta.ru/sitemap.xml

Warnings

  • `host` is not a known field.