crunchyscan.fr
robots.txt
Robots Exclusion Standard data for crunchyscan.fr
Resource Scan
Scan Details
| Site Domain | crunchyscan.fr |
| Base Domain | crunchyscan.fr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 6/2/2025, 9:34:59 AM |
| Next Scan | 6/9/2025, 9:34:59 AM |
Last Successful Scan
| Scanned | 12/22/2022, 2:08:50 AM |
| URL | https://crunchyscan.fr/robots.txt |
| Domain IPs | 104.21.96.27, 172.67.150.159, 2606:4700:3033::ac43:969f, 2606:4700:3035::6815:601b |
| Response IP | 104.21.96.27 |
| Found | Yes |
| Hash | 8a009a5904da248c02e8ea0ea9b811a8ae2b1ba5686c6959a9fab6ef8883de01 |
| SimHash | 894888c0e89a |
Other Records
| Field | Value |
|---|---|
| sitemap | https://crunchyscan.fr/sitemap_index.xml |
Comments