vahtav.ru
robots.txt
Robots Exclusion Standard data for vahtav.ru
Resource Scan
Scan Details
| Site Domain | vahtav.ru |
| Base Domain | vahtav.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-01T12:08:36+00:00 |
| Next Scan | 2024-10-15T12:08:36+00:00 |
Last Successful Scan
| Scanned | 2024-09-16T12:07:07+00:00 |
| URL | https://vahtav.ru/robots.txt |
| Domain IPs | 141.8.195.125, 2a0a:2b43:36:24a1:: |
| Response IP | 141.8.195.125 |
| Found | Yes |
| Hash | 6427e3bc018a967454d8c918b2c9f988585df9fc1d63c113a1e276a4dcbffe73 |
| SimHash | 65a3fb5a43b0 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /?p=* |
| Disallow | /2018/* |
| Disallow | /2019/* |
| Disallow | /2020/* |
| Disallow | /2021/* |
| Disallow | /2022/* |
| Disallow | /2023/* |
| Disallow | */advert/* |
| Disallow | /advert/* |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /?feed= |
| Disallow | /wp-admin/ |
| Disallow | /author/ |
| Disallow | /author* |
| Disallow | */author/* |
| Disallow | */page/* |
| Disallow | */trackback/ |
| Disallow | /search |
| Disallow | */tag/* |
| Disallow | /employer-confirm |
*
| Rule | Path |
|---|---|
| Disallow | /?p=* |
| Disallow | /2017/* |
| Disallow | /2018/* |
| Disallow | /2019/* |
| Disallow | /2020/* |
| Disallow | /2021/* |
| Disallow | /2022/* |
| Disallow | /2023/* |
| Disallow | */advert/* |
| Disallow | /advert/* |
| Disallow | */*/feed/*/ |
| Disallow | */feed |
| Disallow | /?feed= |
| Disallow | /wp-admin/ |
| Disallow | /author/ |
| Disallow | /author* |
| Disallow | */author/* |
| Disallow | */page/* |
| Disallow | */trackback/ |
| Disallow | /search |
| Disallow | */tag/* |
| Disallow | /advert-category/* |
| Disallow | /employer-confirm |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vahtav.ru/sitemap.xml |
Warnings
- `host` is not a known field.