afisha.zp.ua
robots.txt

Robots Exclusion Standard data for afisha.zp.ua

Resource Scan

Scan Details

Site Domain afisha.zp.ua
Base Domain afisha.zp.ua
Scan Status Ok
Last Scan2024-11-10T16:58:23+00:00
Next Scan 2024-11-17T16:58:23+00:00

Last Scan

Scanned2024-11-10T16:58:23+00:00
URL https://afisha.zp.ua/robots.txt
Domain IPs 91.239.233.47
Response IP 91.239.233.47
Found Yes
Hash 9ee7936ae8a589043255fc18a0fda4d5d2e6d373a89e2c6dd9f1f9e1a8d7ed06
SimHash 7a109ce28bf5

Groups

*

Rule Path
Disallow /ajax
Allow /

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /get_raiting
Allow /

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /get_i
Allow /

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /get_horecaraiting
Allow /

Other Records

Field Value
crawl-delay 30

yandexblogs

Rule Path
Disallow *

mozilla/5.0 (compatible; yandexblogs/0.99; robot; +http://yandex.com/bots)

Rule Path
Disallow *

twiceler

Rule Path
Disallow *

mozilla/5.0 (twiceler-0.9 http://www.cuill.com/twiceler/robot.html)

Rule Path
Disallow *

psbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow *

archive.org

Rule Path
Disallow *

yandex

No rules defined. All paths allowed.

Warnings

  • `host` is not a known field.