Log In Sign Up

wollplatz.de
robots.txt

Robots Exclusion Standard data for wollplatz.de

Resource Scan

Scan Details

Site Domain wollplatz.de
Base Domain wollplatz.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-21T18:42:26+00:00
Next Scan 2025-01-19T18:42:26+00:00

Last Successful Scan

Scanned2024-03-03T17:05:20+00:00
URL https://wollplatz.de/robots.txt
Redirect https://www.wollplatz.de/robots.txt
Redirect Domain www.wollplatz.de
Redirect Base wollplatz.de
Domain IPs 162.159.140.143, 172.66.0.141, 2606:4700:7::8d, 2a06:98c1:58::8d
Redirect IPs 162.159.140.143, 172.66.0.141, 2606:4700:7::8d, 2a06:98c1:58::8d
Response IP 172.66.0.141
Found Yes
Hash 4e99acbc23e8934119cba78ec0f429c559908af82aeee1a628873796342d4d58
SimHash dd96f0508c3d

Groups

*

Rule Path
Disallow /bestellungen.html
Disallow /de/bestellungen.html
Disallow /login.html
Disallow /de/login.html
Disallow /bestellen/login.html
Disallow /de/bestellen/login.html
Disallow /bestellen/informationen.html
Disallow /de/bestellen/informationen.html
Disallow /warenkorb.html
Disallow /de/warenkorb.html
Disallow /wunschliste.html
Disallow /de/wunschliste.html
Disallow /registrieren.html
Disallow /de/registrieren.html
Disallow /profil.html
Disallow /de/profil.html
Disallow /passwort-vergessen.html
Disallow /de/passwort-vergessen.html
Disallow /passwort-resetten.html
Disallow /de/passwort-resetten.html
Disallow /passwort-andern.html
Disallow /de/passwort-andern.html
Disallow /zahlen/$
Disallow /de/zahlen/$
Disallow /suche.html?*
Disallow /de/suche.html?*
Disallow /preisanfrage.html
Disallow /de/preisanfrage.html
Disallow /management-gebruikers-duits.html
Disallow /de/management-gebruikers-duits.html
Disallow /management-lieferadressen.html
Disallow /de/management-lieferadressen.html
Disallow /management-berechnung-adressen.html
Disallow /de/management-berechnung-adressen.html
Disallow /abmelden-uberprufungsantrag.html
Disallow /de/abmelden-uberprufungsantrag.html
Disallow /zuruck-bestellen.html
Disallow /de/zuruck-bestellen.html
Disallow /zuruck-bestellen-bestellung-auswahlen.html
Disallow /de/zuruck-bestellen-bestellung-auswahlen.html
Disallow /waehle-externen-verkaufer.html
Disallow /de/waehle-externen-verkaufer.html
Disallow /Ruckgabeanforderung.html
Disallow /de/Ruckgabeanforderung.html
Disallow /meine-digitalen-Produkte.html
Disallow /de/meine-digitalen-Produkte.html
Disallow /x19y46/dashboard.html
Disallow /de/x19y46/dashboard.html
Disallow /x19y46/dashboard/login.html
Disallow /de/x19y46/dashboard/login.html
Disallow /benotigte-produkte/$
Disallow /de/benotigte-produkte/$
Disallow /angebots.html
Disallow /de/angebots.html
Disallow /angebots-detail.html
Disallow /de/angebots-detail.html
Disallow /angebots-detail/$
Disallow /de/angebots-detail/$
Disallow /uberprufen-sie-die-e-mail-adresse.html
Disallow /de/uberprufen-sie-die-e-mail-adresse.html
Disallow /verpackungsartikel.html
Disallow /de/verpackungsartikel.html
Disallow /Angebotsliste.html
Disallow /de/Angebotsliste.html
Disallow /webfunctions/utypia$
Disallow /zoek/$
Disallow /setcrossdomaintoken/$
Disallow /m/93/OfferteAanvraag.aspx$
Disallow /m/93/MonsterAanvraag.aspx$
Disallow /afterpay/$
Disallow /riverty/$
Disallow /cardgate/$
Disallow /pin/$
Disallow /multisafe-pay/$
Disallow /cfg/$
Disallow /debtorlogo/$
Disallow /orderdetail/$
Disallow /orderdetail/$
Disallow /bestelldetails/$
Disallow /details-de-la-commande/$
Disallow /detalle-del-pedido/$
Disallow /dettaglio-dell-ordine/$
Disallow /bedankt/$
Disallow /thanks/$
Disallow /danke/$
Disallow /merci/$
Disallow /gracias/$
Disallow /grazie/$
Disallow /hulu-egg-zip-jack-bestbuy-l4.html
Disallow /TradeTracker/$
Disallow /tradetracker/$
Disallow /rp/$
Disallow *.axd$
Disallow *.axd
Disallow *.ashx$
Disallow *.ashx

Other Records

Field Value
crawl-delay 3

baiduspider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

ingrid

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

jyxobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yahoo! slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

twengabot-2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ucrawler/1.0

Rule Path
Disallow /

ucrawler

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

vagabondo

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

screaming frog seo spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mail.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60
Back to top

Other Records

Field Value
sitemap https://www.wollplatz.de/sitemap_index.xml
Back to top

Comments

  • https://megaindex.com/crawler
  • Version:
  • Azure\185.2.2.7098
  • Directory:
  • Next-2024-02-06-S185.2.2
  • Style:
  • s186
Back to top