autospot.ru
robots.txt
Robots Exclusion Standard data for autospot.ru
Resource Scan
Scan Details
| Site Domain | autospot.ru |
| Base Domain | autospot.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-09-05T09:57:30+00:00 |
| Next Scan | 2024-12-04T09:57:30+00:00 |
Last Successful Scan
| Scanned | 2023-11-10T06:46:06+00:00 |
| URL | https://autospot.ru/robots.txt |
| Domain IPs | 185.65.149.125 |
| Response IP | 185.65.149.125 |
| Found | Yes |
| Hash | 6326773489ff6e720535c9e7c84fc9e3c5e2bd6aa4cee605f692ebf6851a826b |
| SimHash | 4cb1c9417b1c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *? |
| Disallow | *%26 |
| Disallow | /index.php |
| Disallow | /scripts/ |
| Disallow | /w/ |
| Disallow | /brands/chery/tiggo7pro/suv/review/4336/ |
| Disallow | /search* |
| Disallow | /*_openstat |
| Disallow | /*test-drive |
| Disallow | /*insurance |
| Disallow | /ti/$ |
| Disallow | /nps |
| Allow | *car_ids |
| Disallow | /credit-online/ |
| Disallow | /a/ |
| Disallow | /alfabank/$ |
| Disallow | */promo/$ |
| Disallow | /l/ |
| Disallow | /to-sms-thanks/$ |
| Disallow | /widget/ |
| Disallow | /*trade_in |
| Disallow | */brands/*2017 |
| Disallow | */brands/*2016 |
| Disallow | */brands/*2015 |
| Disallow | */brands/*2014 |
| Disallow | */brands/*2013 |
| Disallow | /*review/create/ |
| Disallow | /auth/social/ |
| Disallow | *_msk.xml |
| Disallow | *_spb.xml |
| Disallow | /filters/extended |
| Disallow | /used-car/extended |
| Disallow | /checklist/ |
| Disallow | /sravni/ |
| Disallow | /autoservice/to2/ |
| Allow | */brands/*/used/* |
| Allow | /assets/ |
| Allow | *.css |
| Allow | *.js |
| Allow | /brands/audi/a8l_2017/sedan/price/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://autospot.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.