whatcar.com
robots.txt
Robots Exclusion Standard data for whatcar.com
Resource Scan
Scan Details
| Site Domain | whatcar.com |
| Base Domain | whatcar.com |
| Scan Status | Ok |
| Last Scan | 2024-06-26T01:10:53+00:00 |
| Next Scan | 2024-07-03T01:10:53+00:00 |
Last Scan
| Scanned | 2024-06-26T01:10:53+00:00 |
| URL | https://whatcar.com/robots.txt |
| Redirect | https://www.whatcar.com/robots.txt |
| Redirect Domain | www.whatcar.com |
| Redirect Base | whatcar.com |
| Domain IPs | 52.19.80.137, 52.212.174.79 |
| Redirect IPs | 52.19.80.137, 52.212.174.79 |
| Response IP | 52.212.174.79 |
| Found | Yes |
| Hash | 5553ceb76c9f542a5d78b9eba71f05b61a93eba9db40f1cf3a17c60121f48ec5 |
| SimHash | 791dc8d4b452 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /beta |
| Disallow | /used-car-deal/ |
| Disallow | /my-whatcar |
| Disallow | /car-chooser |
| Disallow | /car-chooser-service |
| Disallow | *?sort=Price |
| Disallow | *newOrUsed* |
| Disallow | /*?uri= |
| Disallow | /*?postcode= |
| Disallow | /*?NA= |
| Disallow | /*?RT= |
| Disallow | /*?rt= |
| Disallow | /Valuation/ValuationResults |
| Disallow | /8527/ |
| Disallow | /search/ |
| Disallow | /*?isforumspage |
| Disallow | */null$ |
| Disallow | */engines$ |
| Disallow | */trims$ |
| Disallow | */undefined/* |
| Disallow | /true-mpg/results |
| Disallow | /call-back |
| Disallow | /coming-soon |
| Disallow | /coming-soon/* |
| Disallow | /new-car-deals/configure/* |
| Disallow | /car-leasing/call-back/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.whatcar.com/sitemap/index.xml |
| sitemap | https://www.whatcar.com/car-leasing/sitemap.xml |