carsvin.ru
robots.txt
Robots Exclusion Standard data for carsvin.ru
Resource Scan
Scan Details
Site Domain | carsvin.ru |
Base Domain | carsvin.ru |
Scan Status | Ok |
Last Scan | 2024-09-28T05:44:38+00:00 |
Next Scan | 2024-10-05T05:44:38+00:00 |
Last Scan
Scanned | 2024-09-28T05:44:38+00:00 |
URL | https://carsvin.ru/robots.txt |
Domain IPs | 178.159.39.178 |
Response IP | 178.159.39.178 |
Found | Yes |
Hash | 8bf8190422c5fd0e1b1ea8f1451eaaa7b0a92f1b42ec9c80a918505e8c7f2013 |
SimHash | 6d005e534d56 |
Groups
*
Rule | Path |
---|---|
Disallow | /setcookie.php |
Disallow | /1xzone.php |
Disallow | /online.php |
Disallow | /auto/news/ |
Disallow | /3d/swf/ |
Disallow | /autocheck/ |
Disallow | /carfax/ |
Disallow | /links.php |
Disallow | /shina_calc/ |
Other Records
Field | Value |
---|---|
sitemap | https://carsvin.ru/sitemap-index.xml |
Warnings
- `host` is not a known field.