hist.msu.ru
robots.txt

Robots Exclusion Standard data for hist.msu.ru

Resource Scan

Scan Details

Site Domain hist.msu.ru
Base Domain msu.ru
Scan Status Ok
Last Scan2024-05-31T14:19:10+00:00
Next Scan 2024-06-30T14:19:10+00:00

Last Scan

Scanned2024-05-31T14:19:10+00:00
URL https://hist.msu.ru/robots.txt
Domain IPs 93.180.11.3
Response IP 93.180.11.3
Found Yes
Hash 50b48d56ddcdcdc91b98fe3f0bbfeb59983762cb9801e8fdc979bdd4264eadcc
SimHash 6550dc526715

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2