av.by
robots.txt
Robots Exclusion Standard data for av.by
Resource Scan
Scan Details
| Site Domain | av.by |
| Base Domain | av.by |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-16T06:39:04+00:00 |
| Next Scan | 2024-07-15T06:39:04+00:00 |
Last Successful Scan
| Scanned | 2023-03-24T05:55:19+00:00 |
| URL | https://av.by/robots.txt |
| Domain IPs | 95.130.85.135 |
| Response IP | 95.130.85.135 |
| Found | Yes |
| Hash | 60c029415ed41e411d80f575ab78b8aa6680c756ca9b42aa14b03aeb549edd9b |
| SimHash | 4d0599c52713 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /model_catalog |
| Disallow | /parts_catalog |
| Disallow | /hello_world |
| Disallow | /registration |
| Disallow | /login* |
| Disallow | /static/* |
| Disallow | *event%3D9* |
| Disallow | /filter* |
| Disallow | *?sort=* |
| Disallow | view/verification/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /model_catalog |
| Disallow | /parts_catalog |
| Disallow | /hello_world |
| Disallow | /registration |
| Disallow | /login* |
| Disallow | /static/* |
| Disallow | *event%3D9* |
| Disallow | /filter* |
| Disallow | *?sort=* |
| Disallow | view/verification/ |
*
| Rule | Path |
|---|---|
| Disallow | /model_catalog |
| Disallow | /parts_catalog |
| Disallow | /hello_world |
| Disallow | /registration |
| Disallow | /login* |
| Disallow | /static/* |
| Disallow | *event%3D9* |
| Disallow | /filter* |
| Disallow | *?sort=* |
| Disallow | view/verification/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://avcdn.av.by/sitemap/sitemap.xml |
Warnings
- `clean-param` is not a known field.