dunnesstores.com
robots.txt

Robots Exclusion Standard data for dunnesstores.com

Resource Scan

Scan Details

Site Domain dunnesstores.com
Base Domain dunnesstores.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-11T05:09:53+00:00
Next Scan 2024-11-10T05:09:53+00:00

Last Successful Scan

Scanned2024-06-20T14:42:56+00:00
URL https://dunnesstores.com/robots.txt
Redirect https://www.dunnesstores.com/robots.txt
Redirect Domain www.dunnesstores.com
Redirect Base dunnesstores.com
Domain IPs 104.19.217.38, 104.19.218.38, 2606:4700::6813:d926, 2606:4700::6813:da26
Redirect IPs 104.19.217.38, 104.19.218.38, 2606:4700::6813:d926, 2606:4700::6813:da26
Response IP 104.19.217.38
Found Yes
Hash 105bf3304a1ab6990856a3cef01499c4c86bd916849f8de569869592a01e18f4
SimHash 6d45a940ae91

Groups

*

Rule Path
Disallow /error
Disallow /*?filters
Disallow /*?amp%3Bamp%3Bfilters
Disallow /*?sort=
Disallow /search
Disallow /customer/
Disallow /j_spring_security_check
Disallow /basket/
Disallow /secure/

adsbot-google

Rule Path
Disallow /error
Disallow /*?filters
Disallow /*?amp%3Bamp%3Bfilters
Disallow /*?sort=
Disallow /customer/
Disallow /j_spring_security_check
Disallow /basket/
Disallow /secure/
Allow /search

adsbot-google-mobile

Rule Path
Disallow /error
Disallow /*?filters
Disallow /*?amp%3Bamp%3Bfilters
Disallow /*?sort=
Disallow /customer/
Disallow /j_spring_security_check
Disallow /basket/
Disallow /secure/
Allow /search

Other Records

Field Value
sitemap https://www.dunnesstores.com/sitemapindex.xml