wellness4me.de
robots.txt

Robots Exclusion Standard data for wellness4me.de

Resource Scan

Scan Details

Site Domain wellness4me.de
Base Domain wellness4me.de
Scan Status Ok
Last Scan2024-10-09T23:24:45+00:00
Next Scan 2024-11-08T23:24:45+00:00

Last Scan

Scanned2024-10-09T23:24:45+00:00
URL https://wellness4me.de/robots.txt
Domain IPs 168.119.80.207, 2a01:4f8:252:1db0::2
Response IP 168.119.80.207
Found Yes
Hash 08169bc89d609cb4e0f828359425db7b21ef24aa8dc9709f00287f1aa38fa2f3
SimHash 7a123a70e19d

Groups

bingbot
adidxbot
bingpreview
microsoftpreview
bingbot/2.0

Rule Path
Disallow /*__*
Disallow /navi.php
Disallow /druckansicht.php
Disallow /suche.php
Disallow /bestellabschluss.php
Disallow /bestellvorgang.php
Disallow /jtl.php
Disallow /pass.php
Disallow /registrieren.php
Disallow /warenkorb.php
Disallow /admin
Disallow /admin/*
Disallow /dbeS/*
Disallow /plugins/*
Disallow /jtl-store/__
Disallow /extension-store/__
Allow *

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /navi.php
Disallow /druckansicht.php
Disallow /suche.php
Disallow /bestellabschluss.php
Disallow /bestellvorgang.php
Disallow /jtl.php
Disallow /pass.php
Disallow /registrieren.php
Disallow /warenkorb.php
Disallow /admin
Disallow /admin/*
Disallow /dbeS/*
Disallow /jtl-store/__
Disallow /extension-store/__
Allow *

blexbot
dataforseobot
semrushbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
semrushbot/7~bl
splitsignalbot
yandex
baiduspider
crawler4j
crawler_eb_germany*
crawler_eb_germany_2
crawler_eb_germany_2.0
barkrowler
serpstatbot
webprosbot
mj12bot
addsearchbot
gptbot
imagesiftbot
ccbot
chatgpt-user
anthropic-ai
omgilibot
omgili
facebookbot
urlsumabot / 1.0
t3versionsbot/1.0
pinterestbot
seekportbot
crawler_eb_germany_2.0
domainstatsbot
claudebot
yandexbot
seolyt/1.0
ahrefsbot
censysinspect/1.1
geedoproductsearch
geedobot
amazonbot
claudebot
wpbot
elisabot
awariorssbot
awariosmartbot
hgfalphaxcrawl
seznambot
lcc
seokicks-robot
seokicks

Rule Path
Disallow /

Warnings

  • 1 invalid line.