Log In Sign Up

bader.ch
robots.txt

Robots Exclusion Standard data for bader.ch

Resource Scan

Scan Details

Site Domain bader.ch
Base Domain bader.ch
Scan Status Ok
Last Scan2025-11-17T02:43:44+00:00
Next Scan 2025-12-17T02:43:44+00:00

Last Scan

Scanned2025-11-17T02:43:44+00:00
URL https://bader.ch/robots.txt
Redirect https://www.bader.ch:443/robots.txt
Redirect Domain www.bader.ch
Redirect Base bader.ch
Domain IPs 34.144.248.61
Redirect IPs 104.18.33.121, 172.64.154.135
Response IP 104.18.33.121
Found Yes
Hash fffa7eab2f5b21b3b8257759fb788ef21e669975600a5ba7f5e58e7669a9311e
SimHash 747c7b57ee0d

Groups

*

Rule Path
Disallow
Disallow /warenkorb
Disallow /sepa
Disallow /meinbader/
Allow /meinbader/anmeldung
Disallow /bestellung/*
Disallow /bestelldetails
Disallow /bestellvorgang-konto-erstellen
Disallow /newsletter-abmeldung
Disallow /logout
Disallow /wishlist-hint/
Disallow */produkt-variante?dwvar*
Disallow /winkelmandje
Disallow /mijnbader/
Allow /mijnbader/aanmelding
Disallow /bestelling/*
Disallow /bestelgegevens
Disallow /bestelproces-account-aanmaken
Disallow /uitloggen
Disallow /betaling-en-verzending
Disallow /varukorg
Disallow /mittbader/
Allow /mittbader/logga-in
Disallow /bestaellning/*
Disallow /best%C3%A4llningsdetaljer
Disallow /best%C3%A4llningsprocess-skapa-konto
Disallow /logga-ut
Disallow /betalning-och-leverans
Disallow /on/demandware.servlet/webdav/Sites/Libraries/BADER-DE/default/Garantien/
Disallow /on/demandware.static/-/Sites-master/default/dw42c8b33f/images/datasheet/
Disallow /*.pdf

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

wget

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dcrawl

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

metainspector

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

spyfu

Rule Path
Disallow /

buzzsumo

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

siteimprove

Rule Path
Disallow /

woorank

Rule Path
Disallow /

wappalyzer

Rule Path
Disallow /

whatruns

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

xenu

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

brandwatch

Rule Path
Disallow /

mentionbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webemailextrac

Rule Path
Disallow /

xaldon webspider

Rule Path
Disallow /

xaldon_webspider

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider-video

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider-image

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

atlassianbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

seznambot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

exabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sogou web spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.bader.ch/sitemap_index.xml
Back to top

Comments

  • ========================
  • Bader CH - Robots.txt
  • ========================
  • ========================
  • Disallow specific System Pages DE
  • ========================
  • ========================
  • Disallow specific System Pages NL
  • ========================
  • ========================
  • Disallow specific System Pages SE
  • ========================
  • ========================
  • Disallow folders with PDFs
  • ========================
  • ========================
  • Disallow specific Bots
  • ========================
  • ========================
  • Set Crawl-Delays to reduce Server Load
  • ========================
  • ========================
  • Sitemap
  • ========================
Back to top

Warnings

  • 6 invalid lines.
Back to top