bus-routes.ru
robots.txt
Robots Exclusion Standard data for bus-routes.ru
Resource Scan
Scan Details
Site Domain | bus-routes.ru |
Base Domain | bus-routes.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-04T11:38:16+00:00 |
Next Scan | 2025-02-02T11:38:16+00:00 |
Last Successful Scan
Scanned | 2023-10-11T19:13:18+00:00 |
URL | https://bus-routes.ru/robots.txt |
Domain IPs | 89.253.255.32 |
Response IP | 89.253.255.32 |
Found | Yes |
Hash | bab8dc1d7253c611081cb32e23382b5614915600fdb6fe61b12a82ad38f87d74 |
SimHash | 5c9c24e8e4b1 |
Groups
yandex
Rule | Path |
---|---|
Disallow | /backup* |
Disallow | /board/ |
Disallow | /components/ |
Disallow | /wysiwyg/ |
Disallow | /includes/ |
Disallow | /portfolio/ |
Disallow | /prices/ |
Disallow | /tags/ |
Disallow | *?page= |
Disallow | /users/ |
Disallow | /modules/ |
Disallow | /filters/ |
Disallow | /languages/ |
Disallow | /core/ |
Disallow | /login/ |
Disallow | /admin/ |
Disallow | /registration/ |
Disallow | /tag/ |
Disallow | /search/ |
Disallow | /rss/ |
Disallow | /*search |
Disallow | /*comments |
Disallow | /*login |
Disallow | /*admin |
Disallow | /*registration |
Disallow | /index.php$ |
Disallow | /*/page |
*
Rule | Path |
---|---|
Disallow | /backup* |
Disallow | /board/ |
Disallow | /components/ |
Disallow | /wysiwyg/ |
Disallow | /includes/ |
Disallow | /modules/ |
Disallow | /filters/ |
Disallow | /languages/ |
Disallow | /core/ |
Disallow | /portfolio/ |
Disallow | /prices/ |
Disallow | /tags/ |
Disallow | *?page= |
Disallow | /users/ |
Disallow | /login/ |
Disallow | /admin/ |
Disallow | /registration/ |
Disallow | /tag/ |
Disallow | /search/ |
Disallow | /rss/ |
Disallow | /*search |
Disallow | /*comments |
Disallow | /*login |
Disallow | /*/page |
Disallow | /*admin |
Disallow | /*registration |
Disallow | /index.php$ |
Warnings
- `host` is not a known field.