mybestbrands.de
robots.txt

Robots Exclusion Standard data for mybestbrands.de

Resource Scan

Scan Details

Site Domain mybestbrands.de
Base Domain mybestbrands.de
Scan Status Ok
Last Scan2024-11-07T09:30:13+00:00
Next Scan 2024-11-14T09:30:13+00:00

Last Scan

Scanned2024-11-07T09:30:13+00:00
URL https://mybestbrands.de/robots.txt
Redirect https://www.mybestbrands.de/robots.txt
Redirect Domain www.mybestbrands.de
Redirect Base mybestbrands.de
Domain IPs 142.132.152.215, 162.55.244.34
Redirect IPs 142.132.152.215, 162.55.244.34
Response IP 142.132.152.215
Found Yes
Hash 56ab0fefee4e24214e7f2c49130c60c6f0b39f0756959499580e43b87b299eca
SimHash 1245f920f4b1

Groups

adsbot-google
apis-google
mediapartners-google
adsbot-google-mobile

Rule Path
Allow /
Disallow */clickout/*
Disallow */clickout-sty/*
Disallow */clickout-app/*
Disallow */clickout-gsdirect/*
Disallow /register-clickout/
Disallow /register-clickout-sty/
Disallow /register-dealclick/
Disallow /register-dealview/

*

Rule Path
Allow /
Disallow /*.axd$
Disallow */clickout/*
Disallow */clickout-sty/*
Disallow */clickout-app/*
Disallow */clickout-gsdirect/*
Disallow /transfer/
Disallow /filtre/
Disallow /filter/
Disallow /register-clickout/
Disallow /register-clickout-sty/
Disallow /register-dealclick/
Disallow /register-dealview/
Disallow /myprofile/
Disallow /login/
Disallow /logout/
Disallow /register/
Disallow /bestdeals/
Disallow /fonts/
Disallow /filters/
Disallow /sorting/
Disallow /3rdparty/
Disallow *%26sort%3D
Disallow *seasortorder%3D
Disallow *dealid%3D
Disallow */?product=
Disallow /luxuswelt/
Disallow /Images/Deals/

googlebot

Rule Path
Allow /
Disallow */clickin/*
Disallow */clickout/*
Disallow */clickout-sty/*
Disallow */clickout-app/*
Disallow */clickout-gsdirect/*
Disallow /transfer/
Disallow /filtre/
Disallow /filter/
Disallow /register-clickout/
Disallow /register-dealview/
Disallow /register-clickout/
Disallow /register-clickout-sty/
Disallow /register-dealclick/
Disallow /register-dealview/
Disallow /myprofile/
Disallow /login/
Disallow /logout/
Disallow /register/
Disallow /bestdeals/
Disallow /filters/
Disallow */?filters=
Disallow *filter%3D
Disallow /sorting/
Disallow *SortOrder%3D
Disallow */?sort=
Disallow /3rdparty/
Disallow *pageTags%3D
Disallow *vmexclude%3D
Disallow *pp%3D
Disallow *p%3D
Disallow /search/

grapeshot
ahrefsbot
semrushbot
screaming frog seo spider
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer
gptbot
etaospider
ccbot
searchmetricsbot
botify
rytebot
dataforseobot
amazonbot
bytespider

Product Comment
searchmetricsbot from conductor
Rule Path
Disallow /