quattroruote.it
robots.txt
Robots Exclusion Standard data for quattroruote.it
Resource Scan
Scan Details
Site Domain | quattroruote.it |
Base Domain | quattroruote.it |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-01T01:15:23+00:00 |
Next Scan | 2024-11-30T01:15:23+00:00 |
Last Successful Scan
Scanned | 2024-08-03T01:14:19+00:00 |
URL | https://quattroruote.it/robots.txt |
Redirect | https://www.quattroruote.it/robots.txt |
Redirect Domain | www.quattroruote.it |
Redirect Base | quattroruote.it |
Domain IPs | 34.120.201.168 |
Redirect IPs | 96.17.96.20, 96.17.96.9 |
Response IP | 23.44.4.185 |
Found | Yes |
Hash | 6609514988733f4ccd303b31c369b24b1f1ad84d1b5a805b39cf5b9fc10f96a2 |
SimHash | 0a7a1049e8ea |
Groups
*
Rule | Path |
---|---|
Disallow | /lib/ |
Disallow | /*.php$ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /catalog/ |
Disallow | /customer/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /*SID%3D |
Disallow | */cart/* |
Disallow | */checkout/* |
Disallow | /content/usergenerated/ |
Disallow | /social/authors/ |
Disallow | /system/loadmore/ |
Disallow | /content/tuttotrasporti/ |
Disallow | /content/domusweb/ |
Disallow | /content/cucchiaio/ |
Disallow | *%5BGINDEX%5D* |
Disallow | */_jcr_content/*.html |
Disallow | */feeds/newsRss/feed |
Disallow | /auto-usate/api/ |
Disallow | /auto-usate/service/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.quattroruote.it/Sitemap.xml |
Warnings
- 2 invalid lines.
Comments