kino-teatr.net
robots.txt

Robots Exclusion Standard data for kino-teatr.net

Resource Scan

Scan Details

Site Domain kino-teatr.net
Base Domain kino-teatr.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-08T19:40:38+00:00
Next Scan 2024-07-07T19:40:38+00:00

Last Successful Scan

Scanned2022-04-01T00:21:25+00:00
URL http://kino-teatr.net/robots.txt
Response IP 178.218.212.59
Found Yes
Hash 96504d9cfc22ea3a8d177cd17f5d61aca2b1a4a78af425cefaedcbd604c5fd13
SimHash 4292c0c78037

Groups

slurp

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 30

mail.ru

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/

Other Records

Field Value
crawl-delay 3

bingbot
msnbot

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/

Other Records

Field Value
crawl-delay 3

ahrefsbot
discobot
ezooms
mj12bot
flamingo_searchengine
magpie-crawler
rootle crawler
pimeyes.com crawler
weborama-fetcher
ias-or

Rule Path
Disallow /

yandex

Rule Path
Disallow /amp/
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /acter-site/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/

*

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /acter-site/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/

Warnings

  • `clean-param` is not a known field.