credit-agricole.it
robots.txt
Robots Exclusion Standard data for credit-agricole.it
Resource Scan
Scan Details
Site Domain | credit-agricole.it |
Base Domain | credit-agricole.it |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-12T23:55:49+00:00 |
Next Scan | 2024-07-12T23:55:49+00:00 |
Last Successful Scan
Scanned | 2024-04-21T19:23:57+00:00 |
URL | https://credit-agricole.it/robots.txt |
Redirect | https://www.credit-agricole.it/robots.txt |
Redirect Domain | www.credit-agricole.it |
Redirect Base | credit-agricole.it |
Domain IPs | 217.27.64.9 |
Redirect IPs | 108.156.133.100, 108.156.133.16, 108.156.133.20, 108.156.133.75 |
Response IP | 108.156.133.16 |
Found | Yes |
Hash | f1d652d6f9fd1c24a77b7312d7861569cc091329c4a262896f3abbee6d1f7bb1 |
SimHash | 470555e547d6 |
Groups
*
Rule | Path |
---|---|
Disallow | *?product_id* |
Disallow | */archivio/* |
Disallow | *?q=* |
Disallow | */login* |
Disallow | */ricerca?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.credit-agricole.it/d/sitemap-index.xml |