benjerry.be
robots.txt
Robots Exclusion Standard data for benjerry.be
Resource Scan
Scan Details
| Site Domain | benjerry.be |
| Base Domain | benjerry.be |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-07T05:48:28+00:00 |
| Next Scan | 2026-01-05T05:48:28+00:00 |
Last Successful Scan
| Scanned | 2023-08-26T23:57:52+00:00 |
| URL | https://benjerry.be/robots.txt |
| Redirect | https://www.benjerry.be/robots.txt |
| Redirect Domain | www.benjerry.be |
| Redirect Base | benjerry.be |
| Domain IPs | 54.208.45.22 |
| Redirect IPs | 104.69.154.190 |
| Response IP | 104.69.154.190 |
| Found | Yes |
| Hash | 2185a62220a3a2f7ba385ad44bf46428525d4d03a81466f5f16515fc7698313a |
| SimHash | 1c50d96565f1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /sites/zz/ |
| Disallow | /cms/render/live/en_US/sites/zz |
| Disallow | /nl/values/how-we-do-business/emballage-responsable |
| Disallow | /fr/values/how-we-do-business/emballage-responsable |
| Disallow | /values/how-we-do-business/emballage-responsable |
| Disallow | /nl/whats-new/mini-cups-statement |
| Disallow | /fr/whats-new/mini-cups-statement |
| Disallow | /whats-new/mini-cups-statement |
| Disallow | /nsassets |
| Disallow | /nsassets/* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.benjerry.be/sitemap.xml |
Warnings
- 1 invalid line.