vans.be
robots.txt

Robots Exclusion Standard data for vans.be

Resource Scan

Scan Details

Site Domain vans.be
Base Domain vans.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-09T09:26:04+00:00
Next Scan 2025-12-08T09:26:04+00:00

Last Successful Scan

Scanned2024-07-24T09:23:47+00:00
URL https://vans.be/robots.txt
Redirect https://www.vans.be/robots.txt
Redirect Domain www.vans.be
Redirect Base vans.be
Domain IPs 23.60.205.141
Redirect IPs 118.215.82.31
Response IP 104.69.45.152
Found Yes
Hash 5dc00a821c2dc0e73a48315197c5eb4bea1de73bed07e4f60e4d536b65c7b69a
SimHash 4f131fcac573

Groups

*

Rule Path
Disallow /shop/CompareProductsDisplay
Disallow /shop/OrderCalculate
Disallow /shop/InterestItemAdd
Disallow *VFSearchDisplay*
Disallow *SearchDisplay*
Disallow /shop/VFSearchDisplay
Disallow /webapp/wcs/stores/servlet/SearchDisplay
Disallow /shop/SearchDisplay
Disallow /webapp/wcs/stores/servlet/VFSearchDisplay
Disallow /shop/VFLogoff
Disallow /webapp/wcs/stores/servlet/*iframeDOMWindow%3Dtrue
Disallow /webapp/wcs/stores/servlet/LogonForm
Disallow /webapp/wcs/stores/servlet/OrderItemDisplay
Disallow /webapp/wcs/stores/servlet/TNFContactUsView
Disallow /VFAjaxProductVideoView
Disallow /?CountryPref=
Disallow /*?stop_mobi=

Other Records

Field Value
sitemap https://www.vans.be/.sitemap.xml
sitemap https://www.vans.be/sitemap_10167.xml.gz

Comments

  • robots.txt for http://www.vans.be