domusweb.it
robots.txt
Robots Exclusion Standard data for domusweb.it
Resource Scan
Scan Details
Site Domain | domusweb.it |
Base Domain | domusweb.it |
Scan Status | Ok |
Last Scan | 2024-06-25T19:01:49+00:00 |
Next Scan | 2024-07-02T19:01:49+00:00 |
Last Scan
Scanned | 2024-06-25T19:01:49+00:00 |
URL | https://domusweb.it/robots.txt |
Redirect | https://www.domusweb.it/robots.txt |
Redirect Domain | www.domusweb.it |
Redirect Base | domusweb.it |
Domain IPs | 34.120.201.168 |
Redirect IPs | 104.88.70.107, 23.50.232.249 |
Response IP | 23.59.168.105 |
Found | Yes |
Hash | 5fdc4780be7009410b4a510153d5fc1bae9b5010135a52959985dce7bbd5e409 |
SimHash | 602dcb02e1f2 |
Groups
*
Rule | Path |
---|---|
Disallow | /?p=* |
Disallow | /content/tuttotrasporti/* |
Disallow | /content/cucchiaio/* |
Disallow | /content/quattroruote/ |
Disallow | /*.more.* |
Disallow | /*.proxy.* |
Disallow | /*_jcr_content* |
Disallow | /*.html.html* |
Disallow | /system* |
Disallow | /System* |
Disallow | /bin/* |