dyson.com.au
robots.txt

Robots Exclusion Standard data for dyson.com.au

Resource Scan

Scan Details

Site Domain dyson.com.au
Base Domain dyson.com.au
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-03-29T02:49:40+00:00
Next Scan 2024-06-27T02:49:40+00:00

Last Successful Scan

Scanned2023-05-08T05:22:56+00:00
URL https://www.dyson.com.au/robots.txt
Domain IPs 23.215.7.16, 23.215.7.5
Response IP 23.40.241.169
Found Yes
Hash 500f47d3e85ad5d83603b112a83ecff4e17edc31f9ff4a6c36f97f91bab98007
SimHash 4b35fc48e353

Groups

*

Rule Path
Disallow /index.php/
Disallow /*?
Disallow /checkout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /dyson/parts/*
Disallow /dyson/tools/*
Disallow /catalog/*
Disallow /soft/product/options/id/*

Other Records

Field Value
sitemap https://www.dyson.com.au/pub/media/sitemap.xml