motors.co.uk
robots.txt
Robots Exclusion Standard data for motors.co.uk
Resource Scan
Scan Details
| Site Domain | motors.co.uk |
| Base Domain | motors.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-09T00:47:39+00:00 |
| Next Scan | 2024-11-16T00:47:39+00:00 |
Last Scan
| Scanned | 2024-11-09T00:47:39+00:00 |
| URL | https://motors.co.uk/robots.txt |
| Redirect | https://www.motors.co.uk/robots.txt |
| Redirect Domain | www.motors.co.uk |
| Redirect Base | motors.co.uk |
| Domain IPs | 34.160.196.78 |
| Redirect IPs | 34.160.196.78 |
| Response IP | 34.160.196.78 |
| Found | Yes |
| Hash | 92867e26f483d635afcd02dbef8dffe83a46e17c9b9ba090f949fdde4126b3bf |
| SimHash | 2b3150144fba |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /newcar-* |
| Disallow | /car-* |
| Allow | /car-hacks* |
| Allow | /car-finance-calculator* |
| Allow | /car-price-guide* |
| Allow | /car-tax* |
| Disallow | */new-cars/* |
| Disallow | /*redirect |
| Disallow | /sellnow* |
| Disallow | /content/CMSHelp/* |
| Disallow | /styleguide* |
| Disallow | /Templates/* |
| Disallow | /news/author* |
| Disallow | /vehicle/* |
| Disallow | /sorry* |
| Disallow | /StaticHtml/* |
| Disallow | /*/loader/id* |
| Disallow | /ga-virtual/* |
| Disallow | */vehicle-list/* |
| Disallow | /VehicleDetails.aspx?* |
| Disallow | /vehicledetails.aspx?* |
| Disallow | /*?page=* |
| Disallow | /*?sort=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.motors.co.uk/sitemaps/motors/global.xml |
Comments