douglas.ro
robots.txt

Robots Exclusion Standard data for douglas.ro

Resource Scan

Scan Details

Site Domain douglas.ro
Base Domain douglas.ro
Scan Status Ok
Last Scan2024-04-22T13:52:57+00:00
Next Scan 2024-05-22T13:52:57+00:00

Last Scan

Scanned2024-04-22T13:52:57+00:00
URL https://douglas.ro/robots.txt
Redirect https://www.douglas.ro/robots.txt
Redirect Domain www.douglas.ro
Redirect Base douglas.ro
Domain IPs 40.114.191.163
Redirect IPs 23.215.7.28, 23.215.7.29, 2600:1413:b000:1b::17d7:71c, 2600:1413:b000:1b::17d7:71d
Response IP 23.52.40.34
Found Yes
Hash 03d6ee6af7c0bfbddaa6c15445029b971950260ecbe0c32909e75df34e42ee47
SimHash 6d2032148031

Groups

*

Rule Path
Disallow /watchlist
Disallow /compare
Disallow /checkout
Disallow /register
Disallow /account
Disallow /address
Disallow /lista-de-dorinte
Disallow /widgets
Disallow /listing
Disallow /ticket
Disallow /*?fs=*
Disallow /*?__shop=*
Disallow /*?c=*
Disallow /*?o=*
Disallow /*?sViewport=*
Disallow /*?p=*
Disallow /*?sSearch=*
Disallow /*?module=widgets
Allow /widgets/emotion

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adidxbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mozilla/5.0 (compatible; optimizer; http://crawler.sistrix.net/)

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.douglas.ro/sitemap.xml