pilotms.ru
robots.txt
Robots Exclusion Standard data for pilotms.ru
Resource Scan
Scan Details
| Site Domain | pilotms.ru |
| Base Domain | pilotms.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-07T08:30:02+00:00 |
| Next Scan | 2024-12-07T08:30:02+00:00 |
Last Scan
| Scanned | 2024-11-07T08:30:02+00:00 |
| URL | https://pilotms.ru/robots.txt |
| Domain IPs | 185.114.247.107 |
| Response IP | 185.114.247.107 |
| Found | Yes |
| Hash | 0e0fca5da29fa83f499958c48e4bb2afd442175d6d706080df1d7977291b952b |
| SimHash | 4429d9f36313 |
Groups
yandex
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | /search/ | - |
| Disallow | /auth/ | - |
| Disallow | /service-pages/ | - |
| Disallow | /include/ | - |
| Disallow | /cgi-bin/ | - |
| Disallow | /personal/* | - |
| Disallow | /auth.php | - |
| Disallow | /*?print= | - |
| Disallow | /*%26print%3D | - |
| Disallow | /*register%3Dyes | - |
| Disallow | /*forgot_password%3Dyes | - |
| Disallow | /*change_password%3Dyes | - |
| Disallow | /*login%3Dyes | - |
| Disallow | /*logout%3Dyes | - |
| Disallow | /*auth%3Dyes | - |
| Disallow | /*backurl%3D* | - |
| Disallow | /*back_url%3D* | - |
| Disallow | /*back_url_admin%3D* | - |
| Disallow | /*index.php?set_filter=* | - |
| Disallow | /*index.php?sort=* | - |
| Disallow | /*index.php?arrFilter* | - |
| Disallow | /*?PAGEN | - |
| Disallow | /*?count | - |
| Disallow | /*?action | - |
| Disallow | /access.log | - |
| Disallow | /*?set_filter=* | - |
| Disallow | /*?q=* | - |
| Disallow | /member | - |
| Disallow | /*?showal | - |
| Disallow | */?arrFilter_* | - |
| Disallow | */?sort=* | - |
| Disallow | */?qnt=* | - |
| Disallow | *index.php | - |
| Disallow | /cheaper/ | - |
| Disallow | /buy1click/ | - |
| Disallow | /feedback/ | - |
| Disallow | /recall/ | - |
| Disallow | /email2friend/ | - |
| Disallow | *?pagen_ | - |
| Disallow | */?so=* | - |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Allow | /bitrix/templates/ | - |
| Allow | /bitrix/js/main/ | - |
| Allow | /bitrix/components/ | - |
| Disallow | /search/ | - |
| Disallow | /auth/ | - |
| Disallow | /service-pages/ | - |
| Disallow | /include/ | - |
| Disallow | /cgi-bin/ | - |
| Disallow | /personal/* | - |
| Disallow | /auth.php | - |
| Disallow | /*?print= | - |
| Disallow | /*%26print%3D | - |
| Disallow | /*register%3Dyes | - |
| Disallow | /*forgot_password%3Dyes | - |
| Disallow | /*change_password%3Dyes | - |
| Disallow | /*login%3Dyes | - |
| Disallow | /*logout%3Dyes | - |
| Disallow | /*auth%3Dyes | - |
| Disallow | /*backurl%3D* | - |
| Disallow | /*back_url%3D* | - |
| Disallow | /*back_url_admin%3D* | - |
| Disallow | /*index.php?set_filter=* | - |
| Disallow | /*index.php?sort=* | - |
| Disallow | /*index.php?arrFilter* | - |
| Disallow | /*?PAGEN | - |
| Disallow | /*?count | - |
| Disallow | /*?action | - |
| Disallow | /access.log | - |
| Disallow | /*?set_filter=* | - |
| Disallow | /*?q=* | - |
| Disallow | /member/ | - |
| Disallow | /*?showal | - |
| Disallow | */?arrFilter_* | - |
| Disallow | */?sort=* | - |
| Disallow | */?qnt=* | - |
| Disallow | *index.php | - |
| Disallow | /cheaper/ | - |
| Disallow | /buy1click/ | - |
| Disallow | /feedback/ | - |
| Disallow | /recall/ | - |
| Disallow | /email2friend/ | - |
| Disallow | *?pagen_ | - |
| Disallow | */?so=* | - |
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | empty Disallow instruction SHOULD be there | |
| Disallow | /search/ | - |
| Disallow | /auth/ | - |
| Disallow | /service-pages/ | - |
| Disallow | /include/ | - |
| Disallow | /cgi-bin/ | - |
| Disallow | /personal/* | - |
| Disallow | /auth.php | - |
| Disallow | /*?print= | - |
| Disallow | /*%26print%3D | - |
| Disallow | /*register%3Dyes | - |
| Disallow | /*forgot_password%3Dyes | - |
| Disallow | /*change_password%3Dyes | - |
| Disallow | /*login%3Dyes | - |
| Disallow | /*logout%3Dyes | - |
| Disallow | /*auth%3Dyes | - |
| Disallow | /*backurl%3D* | - |
| Disallow | /*back_url%3D* | - |
| Disallow | /*back_url_admin%3D* | - |
| Disallow | /*index.php?set_filter=* | - |
| Disallow | /*index.php?sort=* | - |
| Disallow | /*index.php?arrFilter* | - |
| Disallow | /*?PAGEN | - |
| Disallow | /*?count | - |
| Disallow | /*?action | - |
| Disallow | /access.log | - |
| Disallow | /*?set_filter=* | - |
| Disallow | /*?q=* | - |
| Disallow | /member/ | - |
| Disallow | /*?showal | - |
| Disallow | */?arrFilter_* | - |
| Disallow | */?sort=* | - |
| Disallow | */?qnt=* | - |
| Disallow | *index.php | - |
| Disallow | /cheaper/ | - |
| Disallow | /buy1click/ | - |
| Disallow | /feedback/ | - |
| Disallow | /recall/ | - |
| Disallow | /email2friend/ | - |
| Disallow | *?pagen_ | - |
| Disallow | */?so=* | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.pilotms.ru/sitemap.xml |
Warnings
- `host` is not a known field.