кино-театр.рф
robots.txt
Robots Exclusion Standard data for кино-театр.рф
Resource Scan
Scan Details
| Site Domain | кино-театр.рф |
| Base Domain | кино-театр.рф |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-10-05T21:52:21+00:00 |
| Next Scan | 2025-01-03T21:52:21+00:00 |
Last Successful Scan
| Scanned | 2022-03-29T13:32:55+00:00 |
| URL | http://www.кино-театр.рф/robots.txt |
| Redirect | http://www.xn----8sbokjthtpc.xn--p1ai/robots.txt |
| Response IP | 178.218.212.59 |
| Found | Yes |
| Hash | 340c5ad23290d4fceeb2f608ca7e914db81a653a2d1351072703aea1f941d7a4 |
| SimHash | 4a92c0c78033 |
Groups
mail.ru
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /search/ |
| Disallow | /dvd/ |
| Disallow | /agent/ |
| Disallow | /report/ |
| Disallow | /audio/ |
| Disallow | /unident/ |
| Disallow | /teatr/bilet/order/ |
| Disallow | /online/stat/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
bingbot
msnbot
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /search/ |
| Disallow | /dvd/ |
| Disallow | /agent/ |
| Disallow | /report/ |
| Disallow | /audio/ |
| Disallow | /unident/ |
| Disallow | /teatr/bilet/order/ |
| Disallow | /online/stat/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
ahrefsbot
discobot
ezooms
mj12bot
flamingo_searchengine
magpie-crawler
rootle crawler
pimeyes.com crawler
weborama-fetcher
ias-or
| Rule | Path |
|---|---|
| Disallow | / |
yandex
| Rule | Path |
|---|---|
| Disallow | /amp/ |
| Disallow | /admin/ |
| Disallow | /search/ |
| Disallow | /dvd/ |
| Disallow | /agent/ |
| Disallow | /acter-site/ |
| Disallow | /report/ |
| Disallow | /audio/ |
| Disallow | /unident/ |
| Disallow | /teatr/bilet/order/ |
| Disallow | /online/stat/ |
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /search/ |
| Disallow | /dvd/ |
| Disallow | /agent/ |
| Disallow | /acter-site/ |
| Disallow | /report/ |
| Disallow | /audio/ |
| Disallow | /unident/ |
| Disallow | /teatr/bilet/order/ |
| Disallow | /online/stat/ |
Warnings
- `clean-param` is not a known field.