avtobus-raspisanie.ru
robots.txt
Robots Exclusion Standard data for avtobus-raspisanie.ru
Resource Scan
Scan Details
| Site Domain | avtobus-raspisanie.ru |
| Base Domain | avtobus-raspisanie.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-19T21:47:09+00:00 |
| Next Scan | 2024-10-18T21:47:09+00:00 |
Last Successful Scan
| Scanned | 2024-06-21T21:45:28+00:00 |
| URL | https://avtobus-raspisanie.ru/robots.txt |
| Domain IPs | 5.63.155.141 |
| Response IP | 5.63.155.141 |
| Found | Yes |
| Hash | be9de09202174b626c4127a5ab039cca32e09c5f7d405832bff4034902da2125 |
| SimHash | 5d7c3cc98613 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /backup* |
| Disallow | /board/ |
| Disallow | /components/ |
| Disallow | /wysiwyg/ |
| Disallow | /includes/ |
| Disallow | /modules/ |
| Disallow | /filters/ |
| Disallow | /languages/ |
| Disallow | /core/ |
| Disallow | /login/ |
| Disallow | /admin/ |
| Disallow | /registration/ |
| Disallow | /tag/ |
| Disallow | /search/ |
| Disallow | /rss/ |
| Disallow | /*search |
| Disallow | /*comments |
| Disallow | /*login |
| Disallow | /*admin |
| Disallow | /*registration |
| Disallow | /index.php$ |
*
| Rule | Path |
|---|---|
| Disallow | /backup* |
| Disallow | /board/ |
| Disallow | /components/ |
| Disallow | /wysiwyg/ |
| Disallow | /includes/ |
| Disallow | /modules/ |
| Disallow | /filters/ |
| Disallow | /languages/ |
| Disallow | /core/ |
| Disallow | /login/ |
| Disallow | /admin/ |
| Disallow | /registration/ |
| Disallow | /tag/ |
| Disallow | /search/ |
| Disallow | /rss/ |
| Disallow | /*search |
| Disallow | /*comments |
| Disallow | /*login |
| Disallow | /*admin |
| Disallow | /*registration |
| Disallow | /index.php$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://avtobus-raspisanie.ru/cache/static/sitemaps/1.xml |
| sitemap | https://avtobus-raspisanie.ru/cache/static/sitemaps/2.xml |
| sitemap | https://avtobus-raspisanie.ru/cache/static/sitemaps/3.xml |
| sitemap | https://avtobus-raspisanie.ru/cache/static/sitemaps/4.xml |
Warnings
- `host` is not a known field.