douglas.it
robots.txt

Robots Exclusion Standard data for douglas.it

Resource Scan

Scan Details

Site Domain douglas.it
Base Domain douglas.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-06-09T05:15:17+00:00
Next Scan 2024-06-23T05:15:17+00:00

Last Successful Scan

Scanned2024-05-18T05:14:10+00:00
URL https://douglas.it/robots.txt
Redirect https://www.douglas.it/robots.txt
Redirect Domain www.douglas.it
Redirect Base douglas.it
Domain IPs 40.114.191.163
Redirect IPs 23.52.114.18, 2600:1413:b000:389::2854, 2600:1413:b000:38e::2854
Response IP 96.16.117.42
Found Yes
Hash c1b80d74086f363c3a31b74dc261afa48362bbf472da8c1f648af73b7b920488
SimHash f5515b56c333

Groups

*

Rule Path
Disallow /account
Disallow /cart
Disallow /checkout
Disallow /error
Disallow /datafeed/*
Disallow /wishlist
Disallow /search.html*
Disallow /search*
Disallow /*?q=*
Disallow /*?bvstate=*
Disallow /*?sourceRef=*
Disallow /*?nomobile=true*
Disallow /*?sortAsc=*
Disallow /*?rdeTemplate=*
Disallow /*?sortField=*

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adidxbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.douglas.it/api/v2/it_IT_dgl/sitemap/sitemap.xml