kempstoncontrols.ae
robots.txt
Robots Exclusion Standard data for kempstoncontrols.ae
Resource Scan
Scan Details
Site Domain | kempstoncontrols.ae |
Base Domain | kempstoncontrols.ae |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-18T04:40:23+00:00 |
Next Scan | 2024-09-25T04:40:23+00:00 |
Last Successful Scan
Scanned | 2024-08-28T21:11:20+00:00 |
URL | https://www.kempstoncontrols.ae/robots.txt |
Domain IPs | 13.35.18.12, 13.35.18.67, 13.35.18.84, 13.35.18.9 |
Response IP | 13.35.18.84 |
Found | Yes |
Hash | f1c44c77062b2b2c836a648fe673563e1c91994143d8facd65d28a3faff7d123 |
SimHash | 1c3b620ef191 |
Groups
*
Rule | Path |
---|---|
Disallow | /account |
Disallow | /account/ |
Disallow | /basket |
Disallow | /basket/ |
Disallow | /checkout |
Disallow | /checkout/ |
Disallow | /acceptquote |
Disallow | /acceptquote/ |
Disallow | /contactus/reportissue |
Disallow | /search/updateresults |
Disallow | /search/suggest |
Disallow | /parts |
Disallow | /currency/set |
Disallow | /country/set |
Disallow | /product/alternate |
Disallow | /product/related |
Disallow | /order |
Disallow | /order/ |
Disallow | /quote |
Disallow | /quote/ |
Disallow | /pendingorder |
Disallow | /pendingorder/ |
Disallow | /api/ |
Disallow | /_fragments/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.kempstoncontrols.ae/sitemaps/ae/sitemapindex.xml |