supersales.de
robots.txt

Robots Exclusion Standard data for supersales.de

Resource Scan

Scan Details

Site Domain supersales.de
Base Domain supersales.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-14T03:26:58+00:00
Next Scan 2024-11-12T03:26:58+00:00

Last Successful Scan

Scanned2023-09-27T03:15:30+00:00
URL https://supersales.de/robots.txt
Redirect https://www.supersales.de/robots.txt
Redirect Domain www.supersales.de
Redirect Base supersales.de
Domain IPs 104.21.40.248, 172.67.158.143, 2606:4700:3033::6815:28f8, 2606:4700:3037::ac43:9e8f
Redirect IPs 104.21.40.248, 172.67.158.143, 2606:4700:3033::6815:28f8, 2606:4700:3037::ac43:9e8f
Response IP 104.21.40.248
Found Yes
Hash fb7473387b4715801c4e8b7fb67fd42d2323ac82dbbc8951a45b827e4c8c20e4
SimHash 5257d0584e9a

Groups

*

Rule Path
Disallow /r/
Disallow /gcr/
Disallow /ri/
Disallow /delen
Disallow /share
Disallow /account
Disallow /konto
Disallow /coupon-view/

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

lcc

Rule Path
Disallow /