douglas.hu
robots.txt

Robots Exclusion Standard data for douglas.hu

Resource Scan

Scan Details

Site Domain douglas.hu
Base Domain douglas.hu
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-29T20:41:05+00:00
Next Scan 2024-09-27T20:41:05+00:00

Last Successful Scan

Scanned2024-05-08T20:39:48+00:00
URL https://douglas.hu/robots.txt
Redirect https://www.douglas.hu/robots.txt
Redirect Domain www.douglas.hu
Redirect Base douglas.hu
Domain IPs 40.114.191.163
Redirect IPs 23.52.171.201, 23.59.168.160, 2600:1417:3f::b81c:eb5b, 2600:1417:3f::b81c:eb60
Response IP 23.52.171.201
Found Yes
Hash 0f8099d578fa83687b35b9a5eb2cf0a105e7b7b641e09abf195ce7137ef862c6
SimHash 4d11b0148330

Groups

*

Rule Path
Disallow /compare
Disallow /checkout
Disallow /register
Disallow /account
Disallow /address
Disallow /kivansaglista
Disallow /widgets
Disallow /listing
Disallow /ticket
Disallow /*?fs=*
Disallow /*?__shop=*
Disallow /*?c=*
Disallow /*?o=*
Disallow /*?sViewport=*
Disallow /*?p=*
Disallow /*?sSearch=*
Allow /widgets/emotion

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adidxbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.douglas.hu/sitemap.xml