kempstoncontrols.co.uk
robots.txt
Robots Exclusion Standard data for kempstoncontrols.co.uk
Resource Scan
Scan Details
Site Domain | kempstoncontrols.co.uk |
Base Domain | kempstoncontrols.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-18T03:55:53+00:00 |
Next Scan | 2024-09-25T03:55:53+00:00 |
Last Successful Scan
Scanned | 2024-08-21T00:18:28+00:00 |
URL | https://www.kempstoncontrols.co.uk/robots.txt |
Domain IPs | 18.155.68.22, 18.155.68.32, 18.155.68.8, 18.155.68.96 |
Response IP | 18.155.68.8 |
Found | Yes |
Hash | b0502a3ccf50da2946a8d26d2027de1378de5944fd6b3fcf485219b64b8211db |
SimHash | 1c3b620ec181 |
Groups
*
Rule | Path |
---|---|
Disallow | /account |
Disallow | /account/ |
Disallow | /basket |
Disallow | /basket/ |
Disallow | /checkout |
Disallow | /checkout/ |
Disallow | /acceptquote |
Disallow | /acceptquote/ |
Disallow | /contactus/reportissue |
Disallow | /search/updateresults |
Disallow | /search/suggest |
Disallow | /parts |
Disallow | /currency/set |
Disallow | /country/set |
Disallow | /product/alternate |
Disallow | /product/related |
Disallow | /order |
Disallow | /order/ |
Disallow | /quote |
Disallow | /quote/ |
Disallow | /pendingorder |
Disallow | /pendingorder/ |
Disallow | /api/ |
Disallow | /_fragments/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.kempstoncontrols.co.uk/sitemaps/gb/sitemapindex.xml |