dyson.com.au
robots.txt
Robots Exclusion Standard data for dyson.com.au
Resource Scan
Scan Details
| Site Domain | dyson.com.au |
| Base Domain | dyson.com.au |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-09-25T02:59:23+00:00 |
| Next Scan | 2024-12-24T02:59:23+00:00 |
Last Successful Scan
| Scanned | 2023-05-08T05:22:56+00:00 |
| URL | https://www.dyson.com.au/robots.txt |
| Domain IPs | 23.215.7.16, 23.215.7.5 |
| Response IP | 23.40.241.169 |
| Found | Yes |
| Hash | 500f47d3e85ad5d83603b112a83ecff4e17edc31f9ff4a6c36f97f91bab98007 |
| SimHash | 4b35fc48e353 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /index.php/ |
| Disallow | /*? |
| Disallow | /checkout/ |
| Disallow | /app/ |
| Disallow | /lib/ |
| Disallow | /*.php$ |
| Disallow | /pkginfo/ |
| Disallow | /report/ |
| Disallow | /var/ |
| Disallow | /catalog/ |
| Disallow | /customer/ |
| Disallow | /sendfriend/ |
| Disallow | /review/ |
| Disallow | /*SID%3D |
| Disallow | /dyson/parts/* |
| Disallow | /dyson/tools/* |
| Disallow | /catalog/* |
| Disallow | /soft/product/options/id/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dyson.com.au/pub/media/sitemap.xml |