douglas.it
robots.txt
Robots Exclusion Standard data for douglas.it
Resource Scan
Scan Details
Site Domain | douglas.it |
Base Domain | douglas.it |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-06-09T05:15:17+00:00 |
Next Scan | 2024-06-23T05:15:17+00:00 |
Last Successful Scan
Scanned | 2024-05-18T05:14:10+00:00 |
URL | https://douglas.it/robots.txt |
Redirect | https://www.douglas.it/robots.txt |
Redirect Domain | www.douglas.it |
Redirect Base | douglas.it |
Domain IPs | 40.114.191.163 |
Redirect IPs | 23.52.114.18, 2600:1413:b000:389::2854, 2600:1413:b000:38e::2854 |
Response IP | 96.16.117.42 |
Found | Yes |
Hash | c1b80d74086f363c3a31b74dc261afa48362bbf472da8c1f648af73b7b920488 |
SimHash | f5515b56c333 |
Groups
*
Rule | Path |
---|---|
Disallow | /account |
Disallow | /cart |
Disallow | /checkout |
Disallow | /error |
Disallow | /datafeed/* |
Disallow | /wishlist |
Disallow | /search.html* |
Disallow | /search* |
Disallow | /*?q=* |
Disallow | /*?bvstate=* |
Disallow | /*?sourceRef=* |
Disallow | /*?nomobile=true* |
Disallow | /*?sortAsc=* |
Disallow | /*?rdeTemplate=* |
Disallow | /*?sortField=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.douglas.it/api/v2/it_IT_dgl/sitemap/sitemap.xml |