craigo.it
robots.txt
Robots Exclusion Standard data for craigo.it
Resource Scan
Scan Details
| Site Domain | craigo.it |
| Base Domain | craigo.it |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-01T01:20:24+00:00 |
| Next Scan | 2025-10-30T01:20:24+00:00 |
Last Successful Scan
| Scanned | 2025-03-12T00:56:06+00:00 |
| URL | https://craigo.it/robots.txt |
| Domain IPs | 13.107.253.59 |
| Response IP | 13.107.253.59 |
| Found | Yes |
| Hash | c510cee9cb4a8b5cd98b1065c801be39c7357942de10b71941325229bdc81815 |
| SimHash | 4b105ce3e613 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Ajax/ |
| Disallow | /bin/ |
| Disallow | /ClickAndCollect/ |
| Disallow | /content/emails/ |
| Disallow | /Pages/ |
| Disallow | /popup/ |
| Disallow | /recupero-password |
| Disallow | /conferma-reset |
| Disallow | /conferma |
| Disallow | /changeStore |
| Disallow | /changeZipCode |
| Disallow | /*/ajax/ |
| Disallow | /*/registrati |
| Disallow | /*/login |
| Disallow | /*/logout |
| Disallow | /*/mio-profilo |
| Disallow | /*/i-miei-ordini |
| Disallow | /*/ordina |
| Disallow | /*/grazie |
| Disallow | /*/carrello |
| Disallow | /*/si-e-verificato-un-errore |
| Disallow | /*/pagamento-fallito |
| Disallow | /*/stampa-lista |
| Disallow | /*.aspx$ |
| Disallow | /*.ashx$ |
| Disallow | /*?sort |
Other Records
| Field | Value |
|---|---|
| sitemap | https://craigo.it/sitemap.xml |
Comments