mrsk-1.ru
robots.txt
Robots Exclusion Standard data for mrsk-1.ru
Resource Scan
Scan Details
| Site Domain | mrsk-1.ru |
| Base Domain | mrsk-1.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-23T06:42:05+00:00 |
| Next Scan | 2024-06-22T06:42:05+00:00 |
Last Scan
| Scanned | 2024-05-23T06:42:05+00:00 |
| URL | https://mrsk-1.ru/robots.txt |
| Domain IPs | 185.178.208.34 |
| Response IP | 185.178.208.34 |
| Found | Yes |
| Hash | 366745e69c84ccf0ad3f58eb78ec89e38dd438d8df2526a1a79ca4369900725e |
| SimHash | 62955c43e4b2 |
Groups
yandex
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | /.include/ | - |
| Disallow | /anketaForm/ | - |
| Disallow | /auth/ | - |
| Disallow | /bitrix/ | - |
| Disallow | /common/ | - |
| Disallow | /desktop_app/ | - |
| Disallow | /en/.include/ | - |
| Disallow | /en/search/ | - |
| Disallow | /search/ | - |
| Disallow | /services/ | - |
| Disallow | /upload/ | - |
| Disallow | /zaglushka/ | - |
| Disallow | /~clients/ | - |
| Disallow | /*?print= | - |
| Disallow | /*%26print%3D | - |
| Disallow | /*register%3Dyes | - |
| Disallow | /*forgot_password%3Dyes | - |
| Disallow | /*change_password%3Dyes | - |
| Disallow | /*login%3Dyes | - |
| Disallow | /*logout%3Dyes | - |
| Disallow | /*auth%3Dyes | - |
| Disallow | /*backurl%3D* | - |
| Disallow | /*BACKURL%3D* | - |
| Disallow | /*back_url%3D* | - |
| Disallow | /*BACK_URL%3D* | - |
| Disallow | /*back_url_admin%3D* | - |
| Disallow | /*?_openstat= | - |
| Disallow | /*?gclid= | - |
| Disallow | /*?utm_source= | - |
| Disallow | /*from%3Dadwords | - |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | /.include/ | - |
| Disallow | /anketaForm/ | - |
| Disallow | /auth/ | - |
| Disallow | /bitrix/ | - |
| Disallow | /common/ | - |
| Disallow | /desktop_app/ | - |
| Disallow | /en/.include/ | - |
| Disallow | /en/search/ | - |
| Disallow | /search/ | - |
| Disallow | /services/ | - |
| Disallow | /upload/ | - |
| Disallow | /zaglushka/ | - |
| Disallow | /~clients/ | - |
| Disallow | /*?print= | - |
| Disallow | /*%26print%3D | - |
| Disallow | /*register%3Dyes | - |
| Disallow | /*forgot_password%3Dyes | - |
| Disallow | /*change_password%3Dyes | - |
| Disallow | /*login%3Dyes | - |
| Disallow | /*logout%3Dyes | - |
| Disallow | /*auth%3Dyes | - |
| Disallow | /*backurl%3D* | - |
| Disallow | /*BACKURL%3D* | - |
| Disallow | /*back_url%3D* | - |
| Disallow | /*BACK_URL%3D* | - |
| Disallow | /*back_url_admin%3D* | - |
| Disallow | /*?_openstat= | - |
| Disallow | /*?gclid= | - |
| Disallow | /*?utm_source= | - |
| Disallow | /*from%3Dadwords | - |
bingbot
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
mail.ru_bot
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
semrushbot
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
mj12bot
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
interfaxbot
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | /customers/customer-service/power-outage/spasibo-za-obrashchenie.php | - |
| Disallow | - |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.mrsk-1.ru/sitemap.xml |
| sitemap | http://www.mrsk-1.ru/en/sitemap.xml |
Warnings
- `host` is not a known field.