kino-teatr.com
robots.txt

Robots Exclusion Standard data for kino-teatr.com

Resource Scan

Scan Details

Site Domain kino-teatr.com
Base Domain kino-teatr.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-08T20:20:31+00:00
Next Scan 2024-07-07T20:20:31+00:00

Last Successful Scan

Scanned2022-03-29T08:48:24+00:00
URL http://kino-teatr.com/robots.txt
Response IP 178.218.212.59
Found Yes
Hash 340c5ad23290d4fceeb2f608ca7e914db81a653a2d1351072703aea1f941d7a4
SimHash 4a92c0c78033

Groups

slurp

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 30

mail.ru

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/

Other Records

Field Value
crawl-delay 3

bingbot
msnbot

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/

Other Records

Field Value
crawl-delay 3

ahrefsbot
discobot
ezooms
mj12bot
flamingo_searchengine
magpie-crawler
rootle crawler
pimeyes.com crawler
weborama-fetcher
ias-or

Rule Path
Disallow /

yandex

Rule Path
Disallow /amp/
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /acter-site/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/

*

Rule Path
Disallow /admin/
Disallow /search/
Disallow /dvd/
Disallow /agent/
Disallow /acter-site/
Disallow /report/
Disallow /audio/
Disallow /unident/
Disallow /teatr/bilet/order/
Disallow /online/stat/

Warnings

  • `clean-param` is not a known field.