benjerry.it
robots.txt
Robots Exclusion Standard data for benjerry.it
Resource Scan
Scan Details
| Site Domain | benjerry.it |
| Base Domain | benjerry.it |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-01T04:19:32+00:00 |
| Next Scan | 2025-12-30T04:19:32+00:00 |
Last Successful Scan
| Scanned | 2023-08-16T20:09:15+00:00 |
| URL | https://benjerry.it/robots.txt |
| Redirect | https://www.benjerry.it/robots.txt |
| Redirect Domain | www.benjerry.it |
| Redirect Base | benjerry.it |
| Domain IPs | 54.208.45.22 |
| Redirect IPs | 104.69.153.162 |
| Response IP | 125.252.217.252 |
| Found | Yes |
| Hash | ca991c2c5921712ee7f81356d4a9ef23a148090d1257778a26f6d80e2d6173c0 |
| SimHash | 185dd944c7f3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /sites/zz/ |
| Disallow | /cms/render/live/en_US/sites/zz |
| Disallow | /valori/come-conduciamo-la-nostra-attivita/carta-riciclata |
| Disallow | /nsassets |
| Disallow | /nsassets/* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.benjerry.it/sitemap.xml |