mrsk-1.ru
robots.txt
Robots Exclusion Standard data for mrsk-1.ru
Resource Scan
Scan Details
Site Domain | mrsk-1.ru |
Base Domain | mrsk-1.ru |
Scan Status | Ok |
Last Scan | 2024-09-20T07:51:41+00:00 |
Next Scan | 2024-10-20T07:51:41+00:00 |
Last Scan
Scanned | 2024-09-20T07:51:41+00:00 |
URL | https://mrsk-1.ru/robots.txt |
Domain IPs | 185.178.208.34 |
Response IP | 185.178.208.34 |
Found | Yes |
Hash | 366745e69c84ccf0ad3f58eb78ec89e38dd438d8df2526a1a79ca4369900725e |
SimHash | 62955c43e4b2 |
Groups
yandex
Rule | Path | Comment |
---|---|---|
Disallow | empty Disallow instruction SHOULD be there | |
Disallow | /.include/ | - |
Disallow | /anketaForm/ | - |
Disallow | /auth/ | - |
Disallow | /bitrix/ | - |
Disallow | /common/ | - |
Disallow | /desktop_app/ | - |
Disallow | /en/.include/ | - |
Disallow | /en/search/ | - |
Disallow | /search/ | - |
Disallow | /services/ | - |
Disallow | /upload/ | - |
Disallow | /zaglushka/ | - |
Disallow | /~clients/ | - |
Disallow | /*?print= | - |
Disallow | /*%26print%3D | - |
Disallow | /*register%3Dyes | - |
Disallow | /*forgot_password%3Dyes | - |
Disallow | /*change_password%3Dyes | - |
Disallow | /*login%3Dyes | - |
Disallow | /*logout%3Dyes | - |
Disallow | /*auth%3Dyes | - |
Disallow | /*backurl%3D* | - |
Disallow | /*BACKURL%3D* | - |
Disallow | /*back_url%3D* | - |
Disallow | /*BACK_URL%3D* | - |
Disallow | /*back_url_admin%3D* | - |
Disallow | /*?_openstat= | - |
Disallow | /*?gclid= | - |
Disallow | /*?utm_source= | - |
Disallow | /*from%3Dadwords | - |
googlebot
Rule | Path | Comment |
---|---|---|
Disallow | empty Disallow instruction SHOULD be there | |
Disallow | /.include/ | - |
Disallow | /anketaForm/ | - |
Disallow | /auth/ | - |
Disallow | /bitrix/ | - |
Disallow | /common/ | - |
Disallow | /desktop_app/ | - |
Disallow | /en/.include/ | - |
Disallow | /en/search/ | - |
Disallow | /search/ | - |
Disallow | /services/ | - |
Disallow | /upload/ | - |
Disallow | /zaglushka/ | - |
Disallow | /~clients/ | - |
Disallow | /*?print= | - |
Disallow | /*%26print%3D | - |
Disallow | /*register%3Dyes | - |
Disallow | /*forgot_password%3Dyes | - |
Disallow | /*change_password%3Dyes | - |
Disallow | /*login%3Dyes | - |
Disallow | /*logout%3Dyes | - |
Disallow | /*auth%3Dyes | - |
Disallow | /*backurl%3D* | - |
Disallow | /*BACKURL%3D* | - |
Disallow | /*back_url%3D* | - |
Disallow | /*BACK_URL%3D* | - |
Disallow | /*back_url_admin%3D* | - |
Disallow | /*?_openstat= | - |
Disallow | /*?gclid= | - |
Disallow | /*?utm_source= | - |
Disallow | /*from%3Dadwords | - |
bingbot
Rule | Path | Comment |
---|---|---|
Disallow | empty Disallow instruction SHOULD be there | |
Disallow | - |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
mail.ru_bot
Rule | Path | Comment |
---|---|---|
Disallow | empty Disallow instruction SHOULD be there | |
Disallow | - |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
semrushbot
Rule | Path | Comment |
---|---|---|
Disallow | empty Disallow instruction SHOULD be there | |
Disallow | - |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
mj12bot
Rule | Path | Comment |
---|---|---|
Disallow | empty Disallow instruction SHOULD be there | |
Disallow | - |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
interfaxbot
Rule | Path | Comment |
---|---|---|
Disallow | empty Disallow instruction SHOULD be there | |
Disallow | - |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path | Comment |
---|---|---|
Disallow | empty Disallow instruction SHOULD be there | |
Disallow | /customers/customer-service/power-outage/spasibo-za-obrashchenie.php | - |
Disallow | - |
Other Records
Field | Value |
---|---|
sitemap | http://www.mrsk-1.ru/sitemap.xml |
sitemap | http://www.mrsk-1.ru/en/sitemap.xml |
Warnings
- `host` is not a known field.