dyson.co.nz
robots.txt
Robots Exclusion Standard data for dyson.co.nz
Resource Scan
Scan Details
| Site Domain | dyson.co.nz |
| Base Domain | dyson.co.nz |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-07-04T07:18:14+00:00 |
| Next Scan | 2024-10-02T07:18:14+00:00 |
Last Successful Scan
| Scanned | 2023-05-09T00:45:34+00:00 |
| URL | https://www.dyson.co.nz/robots.txt |
| Domain IPs | 23.52.171.217, 23.59.168.154 |
| Response IP | 23.52.171.240 |
| Found | Yes |
| Hash | 8c09d8276e3d1508685afd44312d3bef76bf197520e9815577a449a48b62f761 |
| SimHash | 5d2de8806a92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | /app/ |
| Disallow | /catalog/ |
| Disallow | /catalog/product_compare/ |
| Disallow | /catalog/product/view/id/ |
| Disallow | /catalogsearch/ |
| Disallow | /checkout/ |
| Disallow | /customer/ |
| Disallow | /downloader/ |
| Disallow | /dyson/review/ |
| Disallow | /enable-cookies/ |
| Disallow | /index.php/ |
| Disallow | /install/ |
| Disallow | /lib/ |
| Disallow | /pkginfo/ |
| Disallow | /review/product/ |
| Disallow | /report/ |
| Disallow | /sendfriend/ |
| Disallow | /skin/ |
| Disallow | /var/ |
| Disallow | /wishlist/ |
| Disallow | /404/ |
| Disallow | /tag/ |
| Disallow | /*? |
| Disallow | /*SID%3D |
| Disallow | /dyson/review/product/ |
| Disallow | /soft/product/options/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dyson.co.nz/pub/media/sitemap.xml |
| sitemap | https://www.dyson.co.nz/pub/media/sitemap.xml |