douglas.pt
robots.txt

Robots Exclusion Standard data for douglas.pt

Resource Scan

Scan Details

Site Domain douglas.pt
Base Domain douglas.pt
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-06-11T09:22:30+00:00
Next Scan 2024-06-25T09:22:30+00:00

Last Successful Scan

Scanned2024-05-04T09:05:11+00:00
URL https://douglas.pt/robots.txt
Redirect https://www.douglas.pt/robots.txt
Redirect Domain www.douglas.pt
Redirect Base douglas.pt
Domain IPs 40.114.191.163
Redirect IPs 23.52.171.201, 23.59.168.160, 2600:1413:b000:1b::17d7:71c, 2600:1413:b000:1b::17d7:71d
Response IP 23.52.171.201
Found Yes
Hash 6fbf6af85f485fc93c1cb7dfa2bbf2177f041a4bbd35279dc523b4d38337eaa2
SimHash ed01b0548331

Groups

*

Rule Path
Disallow /compare
Disallow /checkout
Disallow /register
Disallow /account
Disallow /address
Disallow /bloco-de-notas
Disallow /widgets
Disallow /listing
Disallow /ticket
Disallow /*?fs=*
Disallow /*?__shop=*
Disallow /*?c=*
Disallow /*?o=*
Disallow /*?sViewport=*
Disallow /*?p=*
Disallow /*?sSearch=*
Allow /widgets/emotion

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adidxbot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.douglas.pt/sitemap.xml