Log In Sign Up

wehkamp.nl
robots.txt

Robots Exclusion Standard data for wehkamp.nl

Resource Scan

Scan Details

Site Domain wehkamp.nl
Base Domain wehkamp.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-13T22:59:56+00:00
Next Scan 2024-12-12T22:59:56+00:00

Last Successful Scan

Scanned2023-08-13T01:54:45+00:00
URL https://wehkamp.nl/robots.txt
Redirect https://www.wehkamp.nl/robots.txt
Redirect Domain www.wehkamp.nl
Redirect Base wehkamp.nl
Domain IPs 104.18.4.65, 104.18.5.65
Redirect IPs 104.18.4.65, 104.18.5.65
Response IP 104.18.4.65
Found Yes
Hash 618a6df33daa21c50d31d387a8f4de1bf3df9caa4966ddb31869e74147953a80
SimHash 41f70682e69a

Groups

adidxbot

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

*

Rule Path
Disallow /zoeken/*
Disallow /Zoeken/*
Disallow /specials/kieskeurig/
Disallow /inspiratie/vlogger-mascha*
Disallow /*/_/
Disallow /*?PI=*
Disallow /werkenbij/umbraco/
Disallow /Blogging/*
Disallow /Blokken/Blokken.aspx*
Disallow /specials/voorbeeld*
Disallow /privatedata/
Disallow /*PI%3D*
Disallow /site/pdp/criteo/*
Disallow /cdn-cgi/
Disallow /-*
Disallow /service/wishlist/wishlist
Disallow /service/account/shopper/data
Disallow /service/basket/basket/minimalContent
Disallow /service/snowplow-stream-collector/
Disallow /service/recommender-fetch/api/v1/combinations
Disallow /service/recommender-fetch/api/v1/more_of_this_brand
Disallow /service/recommender-fetch/api/v1/lastviewed
Disallow /service/lastviewed/v2/items
Disallow /*uitgelicht%3D*
Disallow /*weergave%3D*
Disallow /*%26*%26*
Disallow /*?CC=*
Disallow /*?BC=*
Disallow /*?SC=*
Allow /*pagina%3D*
Allow /*utm_*
Allow /*campagne*
Disallow /site/content-site/*
Disallow /*preview%3D*
Allow /site/content-site/*.css
Allow /site/content-site/*.js
Disallow /*redirectUrl%3D*
Disallow /login/?redirectUrl=*
Disallow /damesmode/damesmode/
Disallow /herenmode/herenmode/
Disallow /kinderen/kinderen/
Disallow /baby/baby/
Disallow /wonen-slapen/wonen-slapen/
Disallow /tuin-klussen/tuin-klussen/
Disallow /huishouden/huishouden/
Disallow /elektronica/elektronica/
Disallow /speelgoed-games/speelgoed-games/
Disallow /sport-vrije-tijd/sport-vrije-tijd/
Disallow /mooi-gezond/mooi-gezond/
Disallow /koken-tafelen/koken-tafelen/
Disallow /sale/sale/
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.jpeg
Allow /*.svg
Allow /*.gif
Allow /*.png
Allow /*.js*
Allow /*.css*
Allow /*.jpg*
Allow /*.jpeg*
Allow /*.svg*
Allow /*.gif*
Allow /*.png*
Allow /zoeken/*.js
Allow /zoeken/*.css
Allow /zoeken/css/*
Allow /service/header-footer/*.js
Allow /service/header-footer/*.css

googlebot

Rule Path
Disallow /*_*_*_*/
Disallow /product/
Disallow /*ArtikelNummer%3D*
Disallow /Winkelen/KenmerkAdviseurArtikel.aspx*
Disallow /Winkelen/ProductOverview.aspx*
Disallow /app/Winkelen/KenmerkAdviseurArtikel.aspx*
Disallow /app/Winkelen/ProductOverview.aspx*
Disallow /Winkelen/Search.aspx*
Disallow /Winkelen/SearchOverview.aspx*
Disallow /winkelen/wensenlijst.aspx*
Disallow /Winkelen/Wensenlijst.aspx*
Disallow /Blokken/Blokken.aspx*
Disallow /zoeken/*
Disallow /Zoeken/*
Disallow /specials/kieskeurig/
Disallow /inspiratie/vlogger*
Disallow /*/_/
Disallow /werkenbij/umbraco/
Disallow /Blogging/*
Disallow /specials/voorbeeld*
Disallow /privatedata/
Disallow /*PI%3D*
Disallow /*/graphql
Disallow /*/undefined
Disallow /*/undefined/
Disallow /site/pdp/criteo/*
Disallow /cdn-cgi/
Disallow /-*
Disallow /service/account/shopper/data
Disallow /service/wishlist/wishlist
Disallow /service/basket/basket/minimalContent
Disallow /service/snowplow-stream-collector/
Disallow /service/recommender-fetch/api/v1/combinations
Disallow /service/recommender-fetch/api/v1/more_of_this_brand
Disallow /service/recommender-fetch/api/v1/lastviewed
Disallow /service/lastviewed/v2/items
Disallow /*uitgelicht%3D*
Disallow /*weergave%3D*
Disallow /*%26*%26*
Disallow /*?CC=*
Disallow /*?BC=*
Disallow /*?SC=*
Allow /*pagina%3D*
Allow /*utm_*
Allow /*campagne*
Disallow /site/content-site/*
Disallow /*preview%3D*
Allow /site/content-site/*.css
Allow /site/content-site/*.js
Disallow /*redirectUrl%3D*
Disallow /login/?redirectUrl=*
Disallow /damesmode/damesmode/
Disallow /herenmode/herenmode/
Disallow /kinderen/kinderen/
Disallow /baby/baby/
Disallow /wonen-slapen/wonen-slapen/
Disallow /tuin-klussen/tuin-klussen/
Disallow /huishouden/huishouden/
Disallow /elektronica/elektronica/
Disallow /speelgoed-games/speelgoed-games/
Disallow /sport-vrije-tijd/sport-vrije-tijd/
Disallow /mooi-gezond/mooi-gezond/
Disallow /koken-tafelen/koken-tafelen/
Disallow /sale/sale/
Disallow /ProfielPagina/
Disallow /specials/voorbeeld*
Disallow /Reviews/TopReviewers.aspx*
Disallow /Reviews/ReviewsOverzicht.aspx*
Disallow /Reviews/SchrijfReview.aspx*
Disallow /Geldzaken/BetaalwijzerPopup.aspx*
Disallow /Geldzaken/EosPopup.aspx*
Disallow /Opruiming/ArtikelOverzichtArtikel.aspx*
Disallow /Matenassistent/Maatinformatie.aspx*
Disallow /klantenservice/download.aspx*
Disallow /*trends--styles-*
Disallow /*/BestellenPanel.aspx*
Disallow /cache.aspx
Disallow /*alleen-verkrijgbaar-i-c-m-actie*
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.jpeg
Allow /*.svg
Allow /*.gif
Allow /*.png
Allow /*.js*
Allow /*.css*
Allow /*.jpg*
Allow /*.jpeg*
Allow /*.svg*
Allow /*.gif*
Allow /*.png*
Allow /zoeken/*.js
Allow /zoeken/*.css
Allow /zoeken/css/*
Allow /service/header-footer/*.js
Allow /service/header-footer/*.css

bingbot

Rule Path
Disallow /*/*_*_*_*/
Disallow /product/
Disallow /*ArtikelNummer%3D*
Disallow /Winkelen/KenmerkAdviseurArtikel.aspx*
Disallow /Winkelen/ProductOverview.aspx*
Disallow /app/Winkelen/KenmerkAdviseurArtikel.aspx*
Disallow /app/Winkelen/ProductOverview.aspx*
Disallow /Winkelen/Search.aspx*
Disallow /Winkelen/SearchOverview.aspx*
Disallow /winkelen/wensenlijst.aspx*
Disallow /Winkelen/Wensenlijst.aspx*
Disallow /Blokken/Blokken.aspx*
Disallow /zoeken/*
Disallow /Zoeken/*
Disallow /specials/kieskeurig/
Disallow /inspiratie/vlogger*
Disallow /*/_/
Disallow /werkenbij/umbraco/
Disallow /Blogging/*
Disallow /specials/voorbeeld*
Disallow /privatedata/
Disallow /*/graphql
Disallow /*/undefined
Disallow /*/undefined/
Disallow /*uitgelicht%3D*
Disallow /*weergave%3D*
Disallow /*%26*%26*
Disallow /*?CC=*
Disallow /*?BC=*
Disallow /*?SC=*
Allow /*pagina%3D*
Allow /*utm_*
Allow /*campagne*
Disallow /site/content-site/*
Disallow /*preview%3D*
Allow /site/content-site/*.css
Allow /site/content-site/*.js
Disallow /*redirectUrl%3D*
Disallow /login/?redirectUrl=*
Disallow /damesmode/damesmode/
Disallow /herenmode/herenmode/
Disallow /kinderen/kinderen/
Disallow /baby/baby/
Disallow /wonen-slapen/wonen-slapen/
Disallow /tuin-klussen/tuin-klussen/
Disallow /huishouden/huishouden/
Disallow /elektronica/elektronica/
Disallow /speelgoed-games/speelgoed-games/
Disallow /sport-vrije-tijd/sport-vrije-tijd/
Disallow /mooi-gezond/mooi-gezond/
Disallow /koken-tafelen/koken-tafelen/
Disallow /sale/sale/
Disallow /ProfielPagina/
Disallow /specials/voorbeeld*
Disallow /Reviews/TopReviewers.aspx*
Disallow /Reviews/ReviewsOverzicht.aspx*
Disallow /Reviews/SchrijfReview.aspx*
Disallow /Geldzaken/BetaalwijzerPopup.aspx*
Disallow /Geldzaken/EosPopup.aspx*
Disallow /Opruiming/ArtikelOverzichtArtikel.aspx*
Disallow /Matenassistent/Maatinformatie.aspx*
Disallow /klantenservice/download.aspx*
Disallow /*trends--styles-*
Disallow /*/BestellenPanel.aspx*
Disallow /cache.aspx
Disallow /*alleen-verkrijgbaar-i-c-m-actie*
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.jpeg
Allow /*.svg
Allow /*.gif
Allow /*.png
Allow /*.js*
Allow /*.css*
Allow /*.jpg*
Allow /*.jpeg*
Allow /*.svg*
Allow /*.gif*
Allow /*.png*
Allow /zoeken/*.js
Allow /zoeken/*.css
Allow /zoeken/css/*
Allow /service/header-footer/*.js
Allow /service/header-footer/*.css

shopwiki

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.wehkamp.nl/sitemap_index.xml
sitemap https://www.wehkamp.nl/sitemap_index.xml
sitemap https://www.wehkamp.nl/sitemap_index.xml
Back to top

Comments

  • disallow from crawling
  • Disallow: /*/graphql
  • Disallow: /*/undefined
  • duplicate categories
  • allow all resources
  • allow special resources that have been disallowed before
  • Specific bot behaviour
  • old PDP/POP structures
  • disallow from crawling
  • duplicate categories
  • Disallow old noindex tags
  • allow all resources
  • allow special resources that have been disallowed before
  • old PDP/POP structures
  • disallow from crawling
  • duplicate categories
  • Disallow old noindex tags
  • allow all resources
  • allow special resources that have been disallowed before
Back to top