walzvital.de
robots.txt

Robots Exclusion Standard data for walzvital.de

Resource Scan

Scan Details

Site Domain walzvital.de
Base Domain walzvital.de
Scan Status Ok
Last Scan2024-09-11T19:41:02+00:00
Next Scan 2024-10-11T19:41:02+00:00

Last Scan

Scanned2024-09-11T19:41:02+00:00
URL https://walzvital.de/robots.txt
Redirect https://www.walzvital.de/robots.txt
Redirect Domain www.walzvital.de
Redirect Base walzvital.de
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.123, 76.76.21.98
Response IP 76.76.21.123
Found Yes
Hash 963ac78204a2b01416428747f43e130456c7e9b44fd89fed9fb9abbc8017b66f
SimHash 6b88a86aec22

Groups

*

Rule Path
Disallow /PasswordResetView
Disallow /ProductDisplay
Disallow /CategoryDisplay
Disallow /BrandDisplay
Disallow /SearchDisplay
Disallow /WalzOrderItemAdd
Disallow /GenericStaticContentPageLayoutView
Disallow /prudsys/
Disallow /walz-webservices/
Disallow /ausverkauft/
Disallow /ads.txt/
Disallow /0*.htm$
Disallow /1*.htm$
Disallow /2*.htm$
Disallow /3*.htm$
Disallow /4*.htm$
Disallow /5*.htm$
Disallow /6*.htm$
Disallow /7*.htm$
Disallow /8*.htm$
Disallow /9*.htm$
Disallow /?group=*
Disallow /%26ffUrl%3D%26navigation%3D*
Disallow /webservices*
Disallow /WishListDisplayView
Disallow /RatingDisplayView
Disallow /ShopCartDisplayView
Disallow /AccountView
Disallow /CatalogRequestView
Disallow /TopCategoriesDisplay
Disallow /AutoSuggestView*
Disallow /MobileNavDisplayView*
Disallow /MainNavigationView*
Disallow /SearchDisplay*

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap /sitemap/index.xml

Comments

  • Zugriff auf alle Dateien erlauben
  • Crawling Optimierung 05.04.2022
  • Nav
  • search

Warnings

  • 1 invalid line.