parkrunmoscow.ru
robots.txt

Robots Exclusion Standard data for parkrunmoscow.ru

Resource Scan

Scan Details

Site Domain parkrunmoscow.ru
Base Domain parkrunmoscow.ru
Scan Status Ok
Last Scan2024-10-25T13:52:13+00:00
Next Scan 2024-11-24T13:52:13+00:00

Last Scan

Scanned2024-10-25T13:52:13+00:00
URL http://parkrunmoscow.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:0:57b5, 2a00:15f8:a000:5:1:12:0:57b5, 2a00:15f8:a000:5:1:13:0:57b5, 2a00:15f8:a000:5:1:14:0:57b5, 90.156.201.106, 90.156.201.113, 90.156.201.12, 90.156.201.36
Response IP 90.156.201.36
Found Yes
Hash 78fceb03675eb593ea077719527767b080bcc75d6e800086fb39b0530553e406
SimHash 6f49c040e3b3

Groups

*

Rule Path
Disallow /cgi-bin/

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5