ben-jerry.gr
robots.txt

Robots Exclusion Standard data for ben-jerry.gr

Resource Scan

Scan Details

Site Domain ben-jerry.gr
Base Domain ben-jerry.gr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-26T20:43:51+00:00
Next Scan 2025-12-25T20:43:51+00:00

Last Successful Scan

Scanned2023-08-15T20:28:13+00:00
URL https://ben-jerry.gr/robots.txt
Redirect https://www.ben-jerry.gr/robots.txt
Redirect Domain www.ben-jerry.gr
Redirect Base ben-jerry.gr
Domain IPs 54.208.45.22
Redirect IPs 104.69.153.162
Response IP 104.69.153.162
Found Yes
Hash 5cffc72f86611cb87cf265ebd8fd37989bb1e3b06bb953f6afdfc5dd9a3db8d3
SimHash 8844ca6067f3

Groups

*

Rule Path
Allow /
Disallow /sites/zz/
Disallow /cms/render/live/en_US/sites/zz
Disallow /values/how-we-do-business/responsibly-sourced-packaging
Disallow /whats-new/mini-cups-statement
Disallow /nsassets
Disallow /nsassets/*

Other Records

Field Value
sitemap http://www.ben-jerry.gr/sitemap.xml