comune.chieri.to.it
robots.txt
Robots Exclusion Standard data for comune.chieri.to.it
Resource Scan
Scan Details
| Site Domain | comune.chieri.to.it |
| Base Domain | chieri.to.it |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-12T20:28:40+00:00 |
| Next Scan | 2026-04-12T20:28:40+00:00 |
Last Successful Scan
| Scanned | 2024-05-30T18:41:47+00:00 |
| URL | https://comune.chieri.to.it/robots.txt |
| Redirect | https://www.comune.chieri.to.it:443/robots.txt |
| Redirect Domain | www.comune.chieri.to.it |
| Redirect Base | chieri.to.it |
| Domain IPs | 13.248.176.129 |
| Redirect IPs | 18.238.192.105, 18.238.192.62, 18.238.192.95, 18.238.192.96, 2600:9000:265c:3c00:4:50bf:7d00:93a1, 2600:9000:265c:4600:4:50bf:7d00:93a1, 2600:9000:265c:8200:4:50bf:7d00:93a1, 2600:9000:265c:a200:4:50bf:7d00:93a1, 2600:9000:265c:a400:4:50bf:7d00:93a1, 2600:9000:265c:b200:4:50bf:7d00:93a1, 2600:9000:265c:c400:4:50bf:7d00:93a1, 2600:9000:265c:ec00:4:50bf:7d00:93a1 |
| Response IP | 18.165.171.26 |
| Found | Yes |
| Hash | c8d63def7482193f0d9d01fbe39c06a16a2465f93c14afbe5353cc76fbbbe284 |
| SimHash | 8410da22a3d8 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /flex/tmp/ |
| Disallow | /flex/Logs/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |