Log In Sign Up

mona.de
robots.txt

Robots Exclusion Standard data for mona.de

Resource Scan

Scan Details

Site Domain mona.de
Base Domain mona.de
Scan Status Ok
Last Scan2025-12-03T19:47:40+00:00
Next Scan 2025-12-10T19:47:40+00:00

Last Scan

Scanned2025-12-03T19:47:40+00:00
URL https://mona.de/robots.txt
Redirect https://www.mona.de:443/robots.txt
Redirect Domain www.mona.de
Redirect Base mona.de
Domain IPs 34.144.248.61
Redirect IPs 104.18.36.244, 172.64.151.12
Response IP 104.18.36.244
Found Yes
Hash 19271c876185a9305d87c154e1ec91fe5d1961ad579bc81a63c4438e34165035
SimHash 76785bd76f07

Groups

*

Rule Path
Disallow
Disallow /warenkorb
Disallow /sepa
Disallow /meinkonto/
Allow /meinkonto/anmeldung
Disallow /bestellung/*
Disallow /bestelldetails
Disallow /bestellvorgang-konto-erstellen
Disallow /newsletter-abmeldung
Disallow /logout
Disallow /wishlist-hint/
Disallow */produkt-variante?dwvar*
Disallow /winkelmandje
Disallow /mijnaccount/
Allow /mijnaccount/aanmelding
Disallow /bestelling/*
Disallow /bestelgegevens
Disallow /bestelproces-account-aanmaken
Disallow /uitloggen
Disallow /on/demandware.servlet/webdav/Sites/Libraries/BADER-DE/default/Garantien/
Disallow /on/demandware.static/-/Sites-master/default/dw42c8b33f/images/datasheet/
Disallow /*.pdf

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

wget

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dcrawl

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

metainspector

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

spyfu

Rule Path
Disallow /

buzzsumo

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

siteimprove

Rule Path
Disallow /

woorank

Rule Path
Disallow /

wappalyzer

Rule Path
Disallow /

whatruns

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

xenu

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

brandwatch

Rule Path
Disallow /

mentionbot

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webemailextrac

Rule Path
Disallow /

xaldon webspider

Rule Path
Disallow /

xaldon_webspider

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider-video

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider-image

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

atlassianbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

seznambot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

exabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sogou web spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.mona.de/sitemap_index.xml
Back to top

Comments

  • ========================
  • MONA DE - Robots.txt
  • ========================
  • ========================
  • Disallow specific System Pages DE
  • ========================
  • ========================
  • Disallow specific System Pages NL
  • ========================
  • ========================
  • Disallow folders with PDFs
  • ========================
  • ========================
  • Disallow specific Bots
  • ========================
  • ========================
  • Set Crawl-Delays to reduce Server Load
  • ========================
  • ========================
  • Sitemap
  • ========================
Back to top

Warnings

  • 6 invalid lines.
Back to top