Log In Sign Up

moebel-vergleich.de
robots.txt

Robots Exclusion Standard data for moebel-vergleich.de

Resource Scan

Scan Details

Site Domain moebel-vergleich.de
Base Domain moebel-vergleich.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-03T21:40:26+00:00
Next Scan 2024-11-01T21:40:26+00:00

Last Successful Scan

Scanned2023-07-04T17:26:09+00:00
URL https://www.moebel-vergleich.de/robots.txt
Domain IPs 89.191.86.183
Response IP 89.191.86.183
Found Yes
Hash d19b984e3629d2d21349eaeb312f901ee5dfe0324184ff1c4db0b47ebb44f5d6
SimHash 369e4af4c60a

Groups

ahrefsbot

Rule Path
Disallow /

voltron

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

buck

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

grobbot

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mega-index

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/2~bl

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

vebidoobot

Rule Path
Disallow /

wonderbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

nutch

Rule Path
Disallow /

discobot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /jslog

*

Rule Path
Disallow /questions-and-answers

*

Rule Path
Disallow /user-data/*

*

Rule Path
Disallow /customer-reviews

*

Rule Path
Disallow /redirect/*

*

Rule Path
Disallow /aehnlicheprodukte/*

*

Rule Path
Disallow /*?*utm_source=*

*

Rule Path
Disallow /*?*utm_medium=*

*

Rule Path
Disallow /*?*utm_campaign=*

*

Rule Path
Disallow /*?*utm_content=*

*

Rule Path
Disallow /*?*utm_term=*

*

Rule Path
Disallow /session

*

Rule Path
Disallow /compact-navigation

*

Rule Path
Disallow /last-seen-products

*

Rule Path
Disallow /produkt/*/preisverlauf

*

Rule Path
Disallow /produkt/*/angebote

*

Rule Path
Disallow /app/*

*

Rule Path
Disallow /kundenbewertung/save

*

Rule Path
Disallow /vergleich/*?*colors=*

*

Rule Path
Disallow /vergleich/*?*marke=*

*

Rule Path
Disallow /vergleich/*?*material=*

*

Rule Path
Disallow /vergleich/*?*liegeflaeche=*

*

Rule Path
Disallow /vergleich/*?*Eigenschaften=*

*

Rule Path
Disallow /vergleich/*?*set-umfang=*

*

Rule Path
Disallow /vergleich/*?*woodquality=*

*

Rule Path
Disallow /vergleich/*?*woodtype=*

*

Rule Path
Disallow /vergleich/*?*Ausstattung=*

*

Rule Path
Disallow /vergleich/*?*bettwaesche-masse=*

*

Rule Path
Disallow /vergleich/*?*liegeflaeche-nestchen=*

*

Rule Path
Disallow /vergleich/*?*matratzengroe%C3%9Fe-bettlaken=*

*

Rule Path
Disallow /vergleich/*?*textiletype=*

*

Rule Path
Disallow /vergleich/*?*eigenschaften_wickelaufs%C3%A4tze=*

*

Rule Path
Disallow /vergleich/*?*textilbezug=*

*

Rule Path
Disallow /vergleich/*?*matratzenkern=*

*

Rule Path
Disallow /vergleich/*?*groesse-wickelauflagen=*

*

Rule Path
Disallow /vergleich/*?*deckengr%C3%B6%C3%9Fe=*

*

Rule Path
Disallow /vergleich/*?*kissengroesse=*

*

Rule Path
Disallow /vergleich/*?*T%C3%BCrart=*

*

Rule Path
Disallow /vergleich/*?*kissengroe%C3%9Fe-1=*

*

Rule Path
Disallow /vergleich/*?*ausstattung_hochstuhl=*

*

Rule Path
Disallow /vergleich/*?*form=*

*

Rule Path
Disallow /vergleich/*?*series=*

*

Rule Path
Disallow /vergleich/*?*figuren_und_themen=*

*

Rule Path
Disallow /vergleich/*?*groesse=*

*

Rule Path
Disallow /vergleich/*?*h%C3%A4rtegrad_kinder=*

*

Rule Path
Disallow /vergleich/*?*Zertifizierung=*

*

Rule Path
Disallow /vergleich/*?*h%C3%A4rtegrad=*

*

Rule Path
Disallow /vergleich/*?*gurtsystem=*

*

Rule Path
Disallow /vergleich/*?*geeignet_bis=*

*

Rule Path
Disallow /vergleich/*?*Befestigung=*

*

Rule Path
Disallow /vergleich/*?*anzahl_sitzplaetze=*

*

Rule Path
Disallow /vergleich/*?*klassifizierung=*

*

Rule Path
Disallow /vergleich/*?*nutzung=*

*

Rule Path
Disallow /vergleich/*?*fahrtrichtung=*

*

Rule Path
Disallow /vergleich/*?*themenwelt=*

*

Rule Path
Disallow /vergleich/*?*altersempfehlung=*

*

Rule Path
Disallow /vergleich/*?*delivery_conditions=*

*

Rule Path
Disallow /vergleich/*?*wheel-size=*

*

Rule Path
Disallow /vergleich/*?*togwert=*

*

Rule Path
Disallow /vergleich/*?*deals=*

*

Rule Path
Disallow /vergleich/*?*top_offers=*

*

Rule Path
Disallow /vergleich/*?*Produkttests=*

*

Rule Path
Disallow /vergleich/*?*Nachhaltigkeit=*

*

Rule Path
Disallow
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • https://megaindex.com/crawler
  • 80legs
  • 80legs' new crawler
  • EMBED_FILTERS_START
  • EMBED_FILTERS_END
Back to top

Warnings

  • 2 invalid lines.
Back to top