douglas.si
robots.txt

Robots Exclusion Standard data for douglas.si

Resource Scan

Scan Details

Site Domain douglas.si
Base Domain douglas.si
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-06-15T23:02:54+00:00
Next Scan 2024-06-29T23:02:54+00:00

Last Successful Scan

Scanned2024-05-08T23:02:25+00:00
URL https://douglas.si/robots.txt
Redirect https://www.douglas.si/robots.txt
Redirect Domain www.douglas.si
Redirect Base douglas.si
Domain IPs 40.114.191.163
Redirect IPs 23.52.171.201, 23.59.168.160, 2600:1413:b000:1b::17d7:71c, 2600:1413:b000:1b::17d7:71d
Response IP 23.59.168.160
Found Yes
Hash 1f7c13411ffa5c4d00bdd1b2c25faf72dcc7bfc3c1affe98123bfa9a20a617fa
SimHash 69043a16c3f0

Groups

*

Rule Path
Disallow /compare
Disallow /checkout
Disallow /register
Disallow /account
Disallow /address
Disallow /lista-zelja
Disallow /widgets
Disallow /listing
Disallow /ticket
Disallow /*?fs=*
Disallow /*?__shop=*
Disallow /*?c=*
Disallow /*?o=*
Disallow /*?sViewport=*
Disallow /*?p=*
Disallow /*?sSearch=*
Disallow /*?number=*
Disallow /Podaci
Disallow /Kosarica
Disallow /NacinPlacanja
Disallow /PregledKupovine
Disallow /ListaZelja
Disallow /*?&page=*
Disallow /*?groupnames=*
Disallow /*?brand=*
Allow /widgets/emotion

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adidxbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.douglas.si/sitemap.xml