dunnesstoresgrocery.com
robots.txt

Robots Exclusion Standard data for dunnesstoresgrocery.com

Resource Scan

Scan Details

Site Domain dunnesstoresgrocery.com
Base Domain dunnesstoresgrocery.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-08T09:48:53+00:00
Next Scan 2024-12-07T09:48:53+00:00

Last Successful Scan

Scanned2024-04-19T05:03:54+00:00
URL https://dunnesstoresgrocery.com/robots.txt
Redirect https://www.dunnesstoresgrocery.com/robots.txt
Redirect Domain www.dunnesstoresgrocery.com
Redirect Base dunnesstoresgrocery.com
Domain IPs 104.16.239.20, 104.16.240.20, 2606:4700::6810:ef14, 2606:4700::6810:f014
Redirect IPs 104.16.239.20, 104.16.240.20, 2606:4700::6810:ef14, 2606:4700::6810:f014
Response IP 104.16.239.20
Found Yes
Hash eaeaa8d3511d1622227d89707d995b8b1f0902f5b86fdbe58882d1cef260d4d7
SimHash 4150c1524731

Groups

*

Rule Path
Allow /