dyson.ae
robots.txt
Robots Exclusion Standard data for dyson.ae
Resource Scan
Scan Details
Site Domain | dyson.ae |
Base Domain | dyson.ae |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-04-05T18:49:40+00:00 |
Next Scan | 2024-07-04T18:49:40+00:00 |
Last Successful Scan
Scanned | 2023-05-15T02:48:05+00:00 |
URL | https://www.dyson.ae/robots.txt |
Domain IPs | 23.52.171.217, 23.59.168.145 |
Response IP | 23.52.171.217 |
Found | Yes |
Hash | 6c101d2aa979d445a58e08be243808639761b90c68d5087bd0943acd7057a61e |
SimHash | 9511e0007b11 |
Groups
*
Rule | Path |
---|---|
Disallow | /dyson/review/product/ |
Disallow | /checkout/ |
Disallow | /soft/product/options/ |