brindley.co.uk
robots.txt
Robots Exclusion Standard data for brindley.co.uk
Resource Scan
Scan Details
Site Domain | brindley.co.uk |
Base Domain | brindley.co.uk |
Scan Status | Ok |
Last Scan | 2024-05-28T11:00:14+00:00 |
Next Scan | 2024-06-27T11:00:14+00:00 |
Last Scan
Scanned | 2024-05-28T11:00:14+00:00 |
URL | https://www.brindley.co.uk/robots.txt |
Domain IPs | 2600:9000:2055:1800:1b:36a9:d3c0:93a1, 2600:9000:2055:6600:1b:36a9:d3c0:93a1, 2600:9000:2055:6800:1b:36a9:d3c0:93a1, 2600:9000:2055:7400:1b:36a9:d3c0:93a1, 2600:9000:2055:8600:1b:36a9:d3c0:93a1, 2600:9000:2055:a000:1b:36a9:d3c0:93a1, 2600:9000:2055:c800:1b:36a9:d3c0:93a1, 2600:9000:2055:e200:1b:36a9:d3c0:93a1, 65.8.11.113, 65.8.11.63, 65.8.11.64, 65.8.11.9 |
Response IP | 52.84.229.55 |
Found | Yes |
Hash | 59375ec1ae95c219b1b52ff9ee2a149a6bfe53871c8cfdd574785c8c7fc9d45e |
SimHash | 032ddea16d42 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | */online-deposits/* |
Disallow | */enquiry/* |
Disallow | */new-car-variants/* |
Disallow | */book-a-test-drive/* |
Disallow | */api/* |
Disallow | */ajax/* |
Disallow | */search/* |
Disallow | *order%3D* |
Disallow | */vehicle-search/* |
Disallow | */new-car-configurator/* |
Disallow | */data-preferences/* |
Disallow | */online-payments/* |
Disallow | */backend.* |
Disallow | */.mh.* |
Disallow | */id-* |
Other Records
Field | Value |
---|---|
sitemap | https://www.brindley.co.uk/sitemap.xml.gz |
Comments