credit-agricole.it
robots.txt

Robots Exclusion Standard data for credit-agricole.it

Resource Scan

Scan Details

Site Domain credit-agricole.it
Base Domain credit-agricole.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-12T23:55:49+00:00
Next Scan 2024-07-12T23:55:49+00:00

Last Successful Scan

Scanned2024-04-21T19:23:57+00:00
URL https://credit-agricole.it/robots.txt
Redirect https://www.credit-agricole.it/robots.txt
Redirect Domain www.credit-agricole.it
Redirect Base credit-agricole.it
Domain IPs 217.27.64.9
Redirect IPs 108.156.133.100, 108.156.133.16, 108.156.133.20, 108.156.133.75
Response IP 108.156.133.16
Found Yes
Hash f1d652d6f9fd1c24a77b7312d7861569cc091329c4a262896f3abbee6d1f7bb1
SimHash 470555e547d6

Groups

*

Rule Path
Disallow *?product_id*
Disallow */archivio/*
Disallow *?q=*
Disallow */login*
Disallow */ricerca?*

Other Records

Field Value
sitemap https://www.credit-agricole.it/d/sitemap-index.xml