serials-now.ru
robots.txt

Robots Exclusion Standard data for serials-now.ru

Resource Scan

Scan Details

Site Domain serials-now.ru
Base Domain serials-now.ru
Scan Status Ok
Last Scan2024-10-29T09:15:46+00:00
Next Scan 2024-11-28T09:15:46+00:00

Last Scan

Scanned2024-10-29T09:15:46+00:00
URL https://serials-now.ru/robots.txt
Domain IPs 104.21.88.21, 172.67.171.249, 2606:4700:3032::6815:5815, 2606:4700:3035::ac43:abf9
Response IP 172.67.171.249
Found Yes
Hash 92ce7dbaa24a31c7ffbc92cbd79116372ba89a577870e2767fa8b1a57a4447e9
SimHash 65189cc0cb91

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://serials-now.ru/sitemap.xml

Warnings

  • `host` is not a known field.