real-biker.ru
robots.txt
Robots Exclusion Standard data for real-biker.ru
Resource Scan
Scan Details
| Site Domain | real-biker.ru |
| Base Domain | real-biker.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-27T04:13:36+00:00 |
| Next Scan | 2024-11-25T04:13:36+00:00 |
Last Successful Scan
| Scanned | 2023-11-02T03:48:10+00:00 |
| URL | https://real-biker.ru/robots.txt |
| Domain IPs | 104.21.44.122, 172.67.199.150, 2606:4700:3035::ac43:c796, 2606:4700:3036::6815:2c7a |
| Response IP | 104.21.44.122 |
| Found | Yes |
| Hash | 4870a3a583fa1196edad8778958f3a9bd2ea2e6a1e1538f017bfc6513aaaf10f |
| SimHash | f4ed3f48f8d2 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /articles/nuzhny-li-prava-na-pitbayk-i-so-skolki-let-mozhno-ezdit-na-nm-70/ |
| Disallow | /admin/* |
| Disallow | /zapchasti/* |
| Disallow | /full_search/* |
| Disallow | /wordpress/* |
| Disallow | /wp-content/* |
| Disallow | /wp-admin/* |
| Disallow | /wp-includes/* |
| Disallow | /collections/* |
| Disallow | /maps/* |
| Disallow | /search/* |
| Disallow | /.well-known/* |
| Disallow | /reklama/* |
| Disallow | */null/* |
| Disallow | *undefined* |
| Disallow | /*?* |
| Disallow | /catalog-models/honda/vtr1000f-firestorm/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /admin/* |
| Disallow | /zapchasti/* |
| Disallow | /full_search/* |
| Disallow | /wordpress/* |
| Disallow | /wp-content/* |
| Disallow | /wp-admin/* |
| Disallow | /wp-includes/* |
| Disallow | /collections/* |
| Disallow | /maps/* |
| Disallow | /search/* |
| Disallow | /.well-known/* |
| Disallow | /reklama/* |
| Disallow | */null/* |
| Disallow | *undefined* |
| Disallow | /*?from |
| Disallow | /*?id=* |
| Disallow | /*?op=* |
| Disallow | /*?ggep_is_embeddable=* |
| Disallow | /*?s=* |
| Disallow | /*?ref=* |
| Disallow | /catalog-models/honda/vtr1000f-firestorm/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://real-biker.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.