Log In Sign Up

shop.check24.de
robots.txt

Robots Exclusion Standard data for shop.check24.de

Resource Scan

Scan Details

Site Domain shop.check24.de
Base Domain check24.de
Scan Status Ok
Last Scan2024-05-24T18:04:14+00:00
Next Scan 2024-06-07T18:04:14+00:00

Last Scan

Scanned2024-05-24T18:04:14+00:00
URL https://shop.check24.de/robots.txt
Redirect https://moebel.check24.de/robots.txt
Redirect Domain moebel.check24.de
Redirect Base check24.de
Domain IPs 89.191.86.121
Redirect IPs 89.191.86.121
Response IP 89.191.86.121
Found Yes
Hash 10e212067727621c966c4a55ae30f868c66fd1209ae5481b1a2f387b4e7b67c1
SimHash 129c5e72853a

Groups

ahrefsbot

Rule Path
Disallow /

voltron

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

buck

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

grobbot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mega-index

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

vebidoobot

Rule Path
Disallow /

wonderbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

nutch

Rule Path
Disallow /

discobot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

*

Rule Path
Disallow /questions-and-answers

*

Rule Path
Disallow /redirect/*

*

Rule Path
Disallow /aehnlicheprodukte/*

*

Rule Path
Disallow /customer-reviews*

*

Rule Path
Disallow /storybook*

*

Rule Path
Disallow /app-rating

*

Rule Path
Disallow /*?*utm_source=*

*

Rule Path
Disallow /*?*utm_medium=*

*

Rule Path
Disallow /*?*utm_campaign=*

*

Rule Path
Disallow /*?*utm_content=*

*

Rule Path
Disallow /*?*utm_term=*

*

Rule Path
Disallow /503*.html

*

Rule Path
Disallow /resize/*

*

Rule Path
Disallow /vergleichen/*?*colors=*

*

Rule Path
Disallow /vergleichen/*?*marke=*

*

Rule Path
Disallow /vergleichen/*?*material=*

*

Rule Path
Disallow /vergleichen/*?*liegeflaeche=*

*

Rule Path
Disallow /vergleichen/*?*Eigenschaften=*

*

Rule Path
Disallow /vergleichen/*?*set_umfang=*

*

Rule Path
Disallow /vergleichen/*?*woodquality=*

*

Rule Path
Disallow /vergleichen/*?*woodtype=*

*

Rule Path
Disallow /vergleichen/*?*Ausstattung=*

*

Rule Path
Disallow /vergleichen/*?*bettwaesche-masse=*

*

Rule Path
Disallow /vergleichen/*?*matratzengroe%C3%9Fe-bettlaken=*

*

Rule Path
Disallow /vergleichen/*?*textilbezug=*

*

Rule Path
Disallow /vergleichen/*?*matratzenkern=*

*

Rule Path
Disallow /vergleichen/*?*deckengr%C3%B6%C3%9Fe=*

*

Rule Path
Disallow /vergleichen/*?*kissengroesse_12=*

*

Rule Path
Disallow /vergleichen/*?*kissengroesse=*

*

Rule Path
Disallow /vergleichen/*?*form=*

*

Rule Path
Disallow /vergleichen/*?*groesse=*

*

Rule Path
Disallow /vergleichen/*?*Zertifizierung=*

*

Rule Path
Disallow /vergleichen/*?*h%C3%A4rtegrad=*

*

Rule Path
Disallow /vergleichen/*?*personenanzahl=*

*

Rule Path
Disallow /vergleichen/*?*delivery_conditions=*

*

Rule Path
Disallow /vergleichen/*?*bezugsmaterial=*

*

Rule Path
Disallow /vergleichen/*?*gestellmaterial=*

*

Rule Path
Disallow /vergleichen/*?*oberfl%C3%A4che=*

*

Rule Path
Disallow /vergleichen/*?*tischplattenmaterial=*

*

Rule Path
Disallow /vergleichen/*?*dekor=*

*

Rule Path
Disallow /vergleichen/*?*stueckanzahl_set=*

*

Rule Path
Disallow /vergleichen/*?*style=*

*

Rule Path
Disallow /vergleichen/*?*ausrichtung=*

*

Rule Path
Disallow /vergleichen/*?*mattress_height=*

*

Rule Path
Disallow /vergleichen/*?*tischgr%C3%B6%C3%9Fe=*

*

Rule Path
Disallow /vergleichen/*?*muster=*

*

Rule Path
Disallow /vergleichen/*?*teppichgr%C3%B6%C3%9Fe=*

*

Rule Path
Disallow /vergleichen/*?*anzahl_der_leuchten=*

*

Rule Path
Disallow /vergleichen/*?*matratzen_set_umfang=*

*

Rule Path
Disallow /vergleichen/*?*deals=*

*

Rule Path
Disallow /vergleichen/*?*handtuchgr%C3%B6%C3%9Fe=*

*

Rule Path
Disallow /vergleichen/*?*eigenschaften_wickelaufs%C3%A4tze=*

*

Rule Path
Disallow /vergleichen/*?*groesse-wickelauflagen=*

*

Rule Path
Disallow /vergleichen/*?*series=*

*

Rule Path
Disallow /vergleichen/*?*figuren_und_themen=*

*

Rule Path
Disallow /vergleichen/*?*gurtsystem=*

*

Rule Path
Disallow /vergleichen/*?*togwert=*

*

Rule Path
Disallow /vergleichen/*?*altersempfehlung=*

*

Rule Path
Disallow /vergleichen/*?*durchmesser=*

*

Rule Path
Disallow /vergleichen/*?*set_groesse=*

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://moebel.check24.de/sitemap/size.xml
sitemap https://moebel.check24.de/sitemap/brandpage.xml
sitemap https://moebel.check24.de/sitemap/material.xml
sitemap https://moebel.check24.de/sitemap/navigation.xml
sitemap https://moebel.check24.de/sitemap/color.xml
sitemap https://moebel.check24.de/sitemap/brand.xml
sitemap https://moebel.check24.de/sitemap/product.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • https://megaindex.com/crawler
  • 80legs
  • 80legs' new crawler
  • EMBED_FILTERS_START
  • EMBED_FILTERS_END
Back to top

Warnings

  • 2 invalid lines.
Back to top