gartencenterkoeman.de
robots.txt

Robots Exclusion Standard data for gartencenterkoeman.de

Resource Scan

Scan Details

Site Domain gartencenterkoeman.de
Base Domain gartencenterkoeman.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-18T09:10:30+00:00
Next Scan 2024-12-02T09:10:30+00:00

Last Successful Scan

Scanned2024-10-11T09:09:47+00:00
URL https://gartencenterkoeman.de/robots.txt
Redirect https://www.gartencenterkoeman.de/robots.txt
Redirect Domain www.gartencenterkoeman.de
Redirect Base gartencenterkoeman.de
Domain IPs 5.172.42.203
Redirect IPs 5.172.42.203
Response IP 5.172.42.203
Found Yes
Hash c39d6d2a7ed785714ccd74986d29b23e003426fc9bf3da941e1d01abf0e4e520
SimHash dd9751508c3d

Groups

*

Rule Path
Disallow /bestellungen.html
Disallow /de/bestellungen.html
Disallow /login.html
Disallow /de/login.html
Disallow /bestellen/login.html
Disallow /de/bestellen/login.html
Disallow /bestellen/informationen.html
Disallow /de/bestellen/informationen.html
Disallow /warenkorb.html
Disallow /de/warenkorb.html
Disallow /wunschliste.html
Disallow /de/wunschliste.html
Disallow /registrieren.html
Disallow /de/registrieren.html
Disallow /profil.html
Disallow /de/profil.html
Disallow /passwort-vergessen.html
Disallow /de/passwort-vergessen.html
Disallow /passwort-resetten.html
Disallow /de/passwort-resetten.html
Disallow /passwort-andern.html
Disallow /de/passwort-andern.html
Disallow /zahlen/$
Disallow /de/zahlen/$
Disallow /suche.html?*
Disallow /de/suche.html?*
Disallow /preisanfrage.html
Disallow /de/preisanfrage.html
Disallow /management-gebruikers-duits.html
Disallow /de/management-gebruikers-duits.html
Disallow /management-lieferadressen.html
Disallow /de/management-lieferadressen.html
Disallow /management-berechnung-adressen.html
Disallow /de/management-berechnung-adressen.html
Disallow /abmelden-uberprufungsantrag.html
Disallow /de/abmelden-uberprufungsantrag.html
Disallow /zuruck-bestellen.html
Disallow /de/zuruck-bestellen.html
Disallow /zuruck-bestellen-bestellung-auswahlen.html
Disallow /de/zuruck-bestellen-bestellung-auswahlen.html
Disallow /waehle-externen-verkaufer.html
Disallow /de/waehle-externen-verkaufer.html
Disallow /ruckgabeanforderung.html
Disallow /de/ruckgabeanforderung.html
Disallow /meine-digitalen-Produkte.html
Disallow /de/meine-digitalen-Produkte.html
Disallow /x19y46/dashboard.html
Disallow /de/x19y46/dashboard.html
Disallow /x19y46/dashboard/login.html
Disallow /de/x19y46/dashboard/login.html
Disallow /benotigte-produkte/$
Disallow /de/benotigte-produkte/$
Disallow /angebots.html
Disallow /de/angebots.html
Disallow /angebots-detail.html
Disallow /de/angebots-detail.html
Disallow /angebots-detail/$
Disallow /de/angebots-detail/$
Disallow /uberprufen-sie-die-e-mail-adresse.html
Disallow /de/uberprufen-sie-die-e-mail-adresse.html
Disallow /verpackungsartikel.html
Disallow /de/verpackungsartikel.html
Disallow /Angebotsliste.html
Disallow /de/Angebotsliste.html
Disallow /webfunctions/utypia$
Disallow /zoek/$
Disallow /setcrossdomaintoken/$
Disallow /m/93/OfferteAanvraag.aspx$
Disallow /m/93/MonsterAanvraag.aspx$
Disallow /afterpay/$
Disallow /riverty/$
Disallow /cardgate/$
Disallow /pin/$
Disallow /multisafe-pay/$
Disallow /cfg/$
Disallow /debtorlogo/$
Disallow /orderdetail/$
Disallow /orderdetail/$
Disallow /bestelldetails/$
Disallow /details-de-la-commande/$
Disallow /detalle-del-pedido/$
Disallow /dettaglio-dell-ordine/$
Disallow /bedankt/$
Disallow /thanks/$
Disallow /danke/$
Disallow /merci/$
Disallow /gracias/$
Disallow /grazie/$
Disallow /hulu-egg-zip-jack-bestbuy-l4.html
Disallow /TradeTracker/$
Disallow /tradetracker/$
Disallow /rp/$
Disallow *.axd$
Disallow *.ashx$

Other Records

Field Value
crawl-delay 3

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

twengabot-2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ucrawler/1.0

Rule Path
Disallow /

ucrawler

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

vagabondo

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

screaming frog seo spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

googlebot

Rule Path
Allow /ScriptResource.axd

Other Records

Field Value
sitemap https://www.gartencenterkoeman.de/sitemap_index.xml

Comments

  • https://megaindex.com/crawler
  • Version:
  • IIS24\203.2.0.36942
  • Directory:
  • Next-2024-10-03-S203.2.0
  • Style:
  • s205