Log In Sign Up

villeroy-boch.pl
robots.txt

Robots Exclusion Standard data for villeroy-boch.pl

Resource Scan

Scan Details

Site Domain villeroy-boch.pl
Base Domain villeroy-boch.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-09T17:12:12+00:00
Next Scan 2024-07-08T17:12:12+00:00

Last Successful Scan

Scanned2024-02-17T17:10:43+00:00
URL https://villeroy-boch.pl/robots.txt
Redirect https://www.villeroy-boch.pl:443/robots.txt
Redirect Domain www.villeroy-boch.pl
Redirect Base villeroy-boch.pl
Domain IPs 34.111.178.165
Redirect IPs 104.18.24.120, 104.18.25.120, 2606:4700::6812:1878, 2606:4700::6812:1978
Response IP 104.18.25.120
Found Yes
Hash 6f6c2dbe3edb0776ea0875037f68a9a6e23fff69b8d6a2e3df704b96cb135d39
SimHash 857ad17235b3

Groups

*

Rule Path Comment
Disallow /*~* -
Disallow /*%2C* -
Disallow *.pdf Block pdf files. Non-standard but works for major search engines.
Disallow /index.php?eID* -
Disallow /index.php?* -
Disallow /?id=* -
Disallow /?&C=DE -
Disallow /styleguide.html -
Disallow /styleguide/gridlayout.html -
Disallow /styleguide/elemente.html -
Disallow /styleguide/gestaltung.html -
Disallow /styleguide/vorlagen.html -
Disallow /styleguide/vorlagen/landingpage-typ-1.html -
Disallow /styleguide/vorlagen/landingpage-typ-2.html -
Disallow /produits/salle-de-bains-et-wellness/recherche.html -
Disallow /products/bath-and-wellness-product-page/searching.html -
Disallow /fr/produits/salle-de-bains-et-wellness/recherche.html -
Disallow /produkter/bad-og-wellness/soeg.html -
Disallow /products/bathroom-and-wellness/searching.html -
Disallow /produkte/bad-und-wellness/suchen.html -
Disallow /nl/producten/badkamer-en-wellness/zoeken.html -
Disallow /prodotti/bagno-e-wellness/cerca.html -
Disallow /produkcija/vannaja-i-velnes/poisk.html -
Disallow /de/produkte/bad-und-wellness/suchen.html -
Disallow /ru/produkcija/vannaja-i-velnes/poisk.html -
Disallow /produkty/lazienka-i-wellness/szukaj.html -
Disallow /en/products/bathroom-and-wellness/searching.html -
Disallow /vyrobky/koupelny-a-wellness/hledat.html -
Disallow /produkte/koupelny-a-wellness/hledat.html -
Disallow /it/prodotti/bagno-e-wellness/cerca.html -
Disallow /productos/bano-y-wellness/busqueda.html -
Disallow /producten/badkamer-en-wellness/zoeken.html -
Disallow /prodotti/piastrelle/cerca.html -
Disallow /produkte/plytki/szukaj.html -
Disallow /products/tiles-from-villeroy-boch/searching.html -
Disallow /produkcija/plitka/poisk.html -
Disallow /fr/produits/carreaux/recherche.html -
Disallow /products/tiles/searching.html -
Disallow /produkte/fliesen/suchen.html -
Disallow /produkter/fliser/soeg.html -
Disallow /producten/tegels/zoeken.html -
Disallow /productos/azulejos/busqueda.html -
Disallow /en/products/tiles/searching.html -
Disallow /produits/carreaux/recherche.html -
Disallow /en/products/kitchen/searching.html -
Disallow /produkcija/kukhnja/poisk.html -
Disallow /de/produkte/kueche/suchen.html -
Disallow /ru/produkcija/kukhnja/poisk.html -
Disallow /produkte/kueche/suchen.html -
Disallow /prodotti/cucina/cerca.html -
Disallow /products/kitchen/searching.html -
Disallow /producten/keuken/zoeken.html -
Disallow /produkte/kuchyne/hledat.html -
Disallow /productos/cocina/busqueda.html -
Disallow /en/products/tableware/searching.html -
Disallow /produkty/porcelana-stolowa/szukaj.html -
Disallow /vyrobky/stolovani/hledat.html -
Disallow /produkcija/tischkultur/suchen.html -
Disallow /producten/tafelcultuur/zoeken.html -
Disallow /nl/producten/tafelcultuur/zoeken.html -
Disallow /produkter/tischkultur/soeg.html -
Disallow /produits/art-de-la-table/recherche.html -
Disallow /produkte/tischkultur/suchen.html -
Disallow /prodotti/arti-della-tavola/cerca.html -
Disallow /products/tableware/searching.html -
Disallow /fr/produits/art-de-la-table/recherche.html -
Disallow /productos/vajilla/busqueda.html -
Disallow /ru/produkcija/tischkultur/suchen.html -
Disallow /fileadmin/upload/tischkultur/pdf/vku_so_schmeckt_freundschaft_2018_fachhandel.pdf -
Disallow /haendlersuche/bad-und-wellness/* -
Disallow /de/haendlersuche/bad-und-wellness/* -
Disallow /dealer-locator/bathroom-and-wellness/* -
Disallow /en/dealer-locator/bathroom-and-wellness/* -
Disallow /direcciones/bano-y-wellness/* -
Disallow /ou-nous-trouver/salle-de-bains-et-wellness/* -
Disallow /fr/ou-nous-trouver/salle-de-bains-et-wellness/* -
Disallow /rivenditori/bagno-e-wellness/* -
Disallow /it/rivenditori/bagno-e-wellness/* -
Disallow /adressen/badkamer-en-wellness/* -
Disallow /nl/adressen/badkamer-en-wellness/* -
Disallow /adresy/lazienka-i-wellness/* -
Disallow /adresa/vannaja-i-velnes/* -
Disallow /ru/adresa/vannaja-i-velnes/* -
Disallow /store-locator/bathroom-and-wellness/* -
Disallow /store-locator/tableware* -
Disallow /fileadmin/upload/tischkultur/images/Neuheiten/Inspiration-Days-22/* -
Disallow /shop/admin/ -
Disallow /shop/app/ -
Disallow /shop/downloader/ -
Disallow /shop/errors/ -
Disallow /shop/includes/ -
Disallow /shop/lib/ -
Disallow /shop/pkginfo/ -
Disallow /shop/shell/ -
Disallow /shop/var/ -
Disallow /*?dir* -
Disallow /*?dir=desc -
Disallow /*?dir=asc -
Disallow /*?limit= -
Disallow /shop/en/catalog/product_compare/ -
Disallow /shop/en/catalog/category/view/ -
Disallow /shop/en/checkout/ -
Disallow /shop/en/contacts/ -
Disallow /shop/en/customer/ -
Disallow /shop/en/js/ -
Disallow /shop/en/newsletter/ -
Disallow /shop/en/sendfriend/ -
Disallow /shop/en/skin/ -
Disallow /shop/en/wishlist/ -
Disallow /shop/de/catalog/product_compare/ -
Disallow /shop/de/catalog/category/view/ -
Disallow /shop/de/checkout/ -
Disallow /shop/de/contacts/ -
Disallow /shop/de/customer/ -
Disallow /shop/de/js/ -
Disallow /shop/de/newsletter/ -
Disallow /shop/de/sendfriend/ -
Disallow /shop/de/skin/ -
Disallow /shop/de/wishlist/ -
Disallow /shop/fr/catalog/product_compare/ -
Disallow /shop/fr/catalog/category/view/ -
Disallow /shop/fr/checkout/ -
Disallow /shop/fr/contacts/ -
Disallow /shop/fr/customer/ -
Disallow /shop/fr/js/ -
Disallow /shop/fr/newsletter/ -
Disallow /shop/fr/sendfriend/ -
Disallow /shop/fr/skin/ -
Disallow /shop/fr/wishlist/ -
Disallow /shop/it/catalog/product_compare/ -
Disallow /shop/it/catalog/category/view/ -
Disallow /shop/it/checkout/ -
Disallow /shop/it/contacts/ -
Disallow /shop/it/customer/ -
Disallow /shop/it/js/ -
Disallow /shop/it/newsletter/ -
Disallow /shop/it/sendfriend/ -
Disallow /shop/it/skin/ -
Disallow /shop/it/wishlist/ -
Disallow /shop/pl/catalog/product_compare/ -
Disallow /shop/pl/catalog/category/view/ -
Disallow /shop/pl/checkout/ -
Disallow /shop/pl/contacts/ -
Disallow /shop/pl/customer/ -
Disallow /shop/pl/js/ -
Disallow /shop/pl/newsletter/ -
Disallow /shop/pl/sendfriend/ -
Disallow /shop/pl/skin/ -
Disallow /shop/pl/wishlist/ -
Disallow /shop/es/catalog/product_compare/ -
Disallow /shop/es/catalog/category/view/ -
Disallow /shop/es/checkout/ -
Disallow /shop/es/contacts/ -
Disallow /shop/es/customer/ -
Disallow /shop/es/js/ -
Disallow /shop/es/newsletter/ -
Disallow /shop/es/sendfriend/ -
Disallow /shop/es/skin/ -
Disallow /shop/es/wishlist/ -
Disallow /shop/nl/catalog/product_compare/ -
Disallow /shop/nl/catalog/category/view/ -
Disallow /shop/nl/checkout/ -
Disallow /shop/nl/contacts/ -
Disallow /shop/nl/customer/ -
Disallow /shop/nl/js/ -
Disallow /shop/nl/newsletter/ -
Disallow /shop/nl/sendfriend/ -
Disallow /shop/nl/skin/ -
Disallow /shop/nl/wishlist/ -
Disallow /shop/nb/catalog/product_compare/ -
Disallow /shop/nb/catalog/category/view/ -
Disallow /shop/nb/checkout/ -
Disallow /shop/nb/contacts/ -
Disallow /shop/nb/customer/ -
Disallow /shop/nb/js/ -
Disallow /shop/nb/newsletter/ -
Disallow /shop/nb/sendfriend/ -
Disallow /shop/nb/skin/ -
Disallow /shop/nb/wishlist/ -
Disallow /*?SID= -
Disallow /shop/checkout* -
Disallow /shop/onestepcheckout/ -
Disallow /shop/customer/ -
Disallow /shop/customer/account/ -
Disallow /shop/customer/account/login/ -
Disallow /shop/catalog/product_compare/ -
Disallow /shop/catalog/category/view/ -
Disallow /shop/catalog/product/view/ -
Disallow /shop/review/ -
Disallow /shop/sendfriend/ -
Disallow /shop/tag/ -
Disallow /shop/wishlist* -
Disallow /shop/productclick/index/ajaxproductclick/* -
Disallow /shop/dummy/ -
Disallow /shop/dummy-complete/ -
Disallow /shop/beispiel-seite.html -
Disallow /shop/fr/dummy/ -
Disallow /shopdummy/ -
Disallow /shop/it/dummy/ -
Disallow /shop/catalogsearch/ -
Disallow /shop/cart* -
Disallow /shop/account* -
Disallow /shop/order-history* -
Disallow /shop/search* -
Disallow /*pmin* -
Disallow /*pmax* -
Disallow /*prefn2* -
Disallow /*prefn3* -
Disallow /*prefn4* -
Disallow /*prefv2* -
Disallow /*prefv3* -
Disallow /*prefv4* -
Disallow /*srule* -
Disallow /on/demandware.store/* -
Disallow /*prefn1%3Ddecor* -

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

jobs.de-robot

Rule Path
Disallow /shop

ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.villeroy-boch.pl/sitemap.xml
Back to top

Comments

  • GENERAL MAGENTO SETTINGS
  • Do not crawl Magento admin page
  • Do not crawl common Magento technical folders
  • MAGENTO SEO IMPROVEMENTS
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl links with session IDs
  • Do not crawl checkout and user account pages
  • Do not crawl seach pages and not-SEO catalog links
  • Do not crawl example pages
  • #87754 Exclude shop search
  • SFCC excludes
  • Slow Down Bingbot
Back to top

Warnings

  • 4 invalid lines.
Back to top