kino-teatr.ru
robots.txt

Robots Exclusion Standard data for kino-teatr.ru

Resource Scan

Scan Details

Site Domain kino-teatr.ru
Base Domain kino-teatr.ru
Scan Status Ok
Last Scan2024-10-05T14:37:59+00:00
Next Scan 2024-10-12T14:37:59+00:00

Last Scan

Scanned2024-10-05T14:37:59+00:00
URL https://kino-teatr.ru/robots.txt
Domain IPs 178.218.216.42
Response IP 178.218.216.42
Found Yes
Hash 767883f3e4b246c28da5bb98116acb16bdd8452ef1afabd7d89f26a5a2b8ca4a
SimHash 4312c1c7c037

Groups

slurp

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 30

mail.ru

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/
Disallow /source/
Disallow /pr/

Other Records

Field Value
crawl-delay 3

bingbot
msnbot

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/
Disallow /source/
Disallow /pr/

Other Records

Field Value
crawl-delay 3

ahrefsbot
discobot
ezooms
mj12bot
flamingo_searchengine
magpie-crawler
rootle crawler
pimeyes.com crawler
weborama-fetcher
ias-or

Rule Path
Disallow /

yandex

Rule Path
Disallow /amp/
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /acter-site/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/
Disallow /source/
Disallow /pr/

*

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /acter-site/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/
Disallow /go/
Disallow /source/
Disallow /pr/

Warnings

  • `clean-param` is not a known field.