burrowsmotorcompany.co.uk
robots.txt
Robots Exclusion Standard data for burrowsmotorcompany.co.uk
Resource Scan
Scan Details
Site Domain | burrowsmotorcompany.co.uk |
Base Domain | burrowsmotorcompany.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server redirected incorrectly. |
Last Scan | 3/25/2025, 6:01:33 PM |
Next Scan | 6/23/2025, 6:01:33 PM |
Last Successful Scan
Scanned | 11/3/2024, 4:29:22 PM |
URL | https://www.burrowsmotorcompany.co.uk/robots.txt |
Domain IPs | 13.33.88.108, 13.33.88.128, 13.33.88.58, 13.33.88.97, 2600:9000:223b:1600:c:9fa2:8480:93a1, 2600:9000:223b:3200:c:9fa2:8480:93a1, 2600:9000:223b:3a00:c:9fa2:8480:93a1, 2600:9000:223b:4c00:c:9fa2:8480:93a1, 2600:9000:223b:4e00:c:9fa2:8480:93a1, 2600:9000:223b:7800:c:9fa2:8480:93a1, 2600:9000:223b:ce00:c:9fa2:8480:93a1, 2600:9000:223b:f600:c:9fa2:8480:93a1 |
Response IP | 13.33.88.128 |
Found | Yes |
Hash | 6d473d5a6dc2277bfef18409b190f8489955ef291fa0640a6750f2436fa76a53 |
SimHash | 890dde03edc3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | */data-preferences/* |
Disallow | */new-car-configurator/* |
Disallow | */vehicle-search/* |
Disallow | */online-deposits/* |
Disallow | *order%3D* |
Disallow | */site/* |
Disallow | */enquiry/* |
Disallow | */new-car-variants/* |
Disallow | */book-a-test-drive/* |
Disallow | */api/* |
Disallow | */ajax/* |
Disallow | */search/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.burrowsmotorcompany.co.uk/sitemap.xml.gz |
Comments