supersales.nl
robots.txt

Robots Exclusion Standard data for supersales.nl

Resource Scan

Scan Details

Site Domain supersales.nl
Base Domain supersales.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-13T09:35:55+00:00
Next Scan 2024-11-11T09:35:55+00:00

Last Successful Scan

Scanned2023-09-26T09:33:05+00:00
URL https://supersales.nl/robots.txt
Redirect https://www.supersales.nl/robots.txt
Redirect Domain www.supersales.nl
Redirect Base supersales.nl
Domain IPs 104.21.0.92, 172.67.150.203, 2606:4700:3030::6815:5c, 2606:4700:3032::ac43:96cb
Redirect IPs 104.21.0.92, 172.67.150.203, 2606:4700:3030::6815:5c, 2606:4700:3032::ac43:96cb
Response IP 172.67.150.203
Found Yes
Hash fb7473387b4715801c4e8b7fb67fd42d2323ac82dbbc8951a45b827e4c8c20e4
SimHash 5257d0584e9a

Groups

*

Rule Path
Disallow /r/
Disallow /gcr/
Disallow /ri/
Disallow /delen
Disallow /share
Disallow /account
Disallow /konto
Disallow /coupon-view/

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

lcc

Rule Path
Disallow /