benjerry.dk
robots.txt
Robots Exclusion Standard data for benjerry.dk
Resource Scan
Scan Details
| Site Domain | benjerry.dk |
| Base Domain | benjerry.dk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-09-26T09:32:28+00:00 |
| Next Scan | 2025-12-25T09:32:28+00:00 |
Last Successful Scan
| Scanned | 2023-08-15T10:35:29+00:00 |
| URL | https://benjerry.dk/robots.txt |
| Redirect | https://www.benjerry.dk/robots.txt |
| Redirect Domain | www.benjerry.dk |
| Redirect Base | benjerry.dk |
| Domain IPs | 54.171.166.213 |
| Redirect IPs | 104.69.154.190 |
| Response IP | 104.69.154.190 |
| Found | Yes |
| Hash | 5e4f690257d50a6dd0927951375d469725da50817b8e7ded39ca2cf87123a38d |
| SimHash | c8708a40e775 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /sites/zz/ |
| Disallow | /cms/render/live/en_US/sites/zz |
| Disallow | /vaerdier/sadan-laver-vi-forretning/ansvarligt-indkbt-emballage |
| Disallow | /whats-new/mini-cups-statement |
| Disallow | /nsassets |
| Disallow | /nsassets/* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.benjerry.dk/sitemap.xml |