motor.ru
robots.txt
Robots Exclusion Standard data for motor.ru
Resource Scan
Scan Details
| Site Domain | motor.ru |
| Base Domain | motor.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-18T21:42:30+00:00 |
| Next Scan | 2024-09-25T21:42:30+00:00 |
Last Scan
| Scanned | 2024-09-18T21:42:30+00:00 |
| URL | https://motor.ru/robots.txt |
| Domain IPs | 81.19.72.28, 81.19.72.29, 81.19.72.30, 81.19.72.31 |
| Response IP | 81.19.72.30 |
| Found | Yes |
| Hash | b8e91125173637d52de09179f7b394a793acb35c10a37f5d8360725d8c8f5cbc |
| SimHash | 6d41a8c1ddb3 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /amp/ |
| Disallow | /search |
| Disallow | /preview/* |
| Disallow | */comments |
| Disallow | /? |
| Disallow | /*%26 |
| Disallow | /sentry/* |
| Disallow | /for_story_topic/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /preview/* |
| Disallow | /sentry/* |
| Disallow | */comments |
| Disallow | /for_story_topic/* |
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /preview/* |
| Disallow | /sentry/* |
| Disallow | */comments |
| Disallow | /for_story_topic/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://motor.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.