mini.co.uk
robots.txt
Robots Exclusion Standard data for mini.co.uk
Resource Scan
Scan Details
Site Domain | mini.co.uk |
Base Domain | mini.co.uk |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-24T03:21:22+00:00 |
Next Scan | 2024-11-22T03:21:22+00:00 |
Last Successful Scan
Scanned | 2022-10-10T04:28:54+00:00 |
URL | https://mini.co.uk/robots.txt |
Redirect | https://www.mini.co.uk/robots.txt |
Redirect Domain | www.mini.co.uk |
Redirect Base | mini.co.uk |
Response IP | 23.44.5.59, 23.44.5.130 |
Found | Yes |
Hash | 300ef12573e582d8b97a39f3097718f72f3239e13908281138675f1fe5ad71bb |
SimHash | 2908e0ed9b10 |
Groups
*
Rule | Path |
---|---|
Disallow | /content/ |
Allow | /content/dam/MINI/ |
Disallow | /? |
Disallow | */home/standard-selector/*.html |
Disallow | */home/disclaimers/*.html |
Disallow | */home/mit-pages/*.html |
Disallow | */home/campaign-templates/*.html |
Disallow | */home/home-stageteaser/*.html |
Disallow | */home/model-selection/*.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.mini.co.uk/en_GB/home.sitemap.xml |