vans.co.uk
robots.txt

Robots Exclusion Standard data for vans.co.uk

Resource Scan

Scan Details

Site Domain vans.co.uk
Base Domain vans.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-28T21:15:27+00:00
Next Scan 2025-11-26T21:15:27+00:00

Last Successful Scan

Scanned2024-07-28T05:11:25+00:00
URL https://vans.co.uk/robots.txt
Redirect https://www.vans.co.uk/robots.txt
Redirect Domain www.vans.co.uk
Redirect Base vans.co.uk
Domain IPs 23.37.43.106
Redirect IPs 118.215.82.31
Response IP 104.69.45.152
Found Yes
Hash a2d4695a651e3842bb2278e6f794ff3f7ddd9d3a89517b2d5fe9bf962b99f856
SimHash 46130fcec532

Groups

*

Rule Path
Disallow /shop/CompareProductsDisplay
Disallow /shop/OrderCalculate
Disallow /shop/InterestItemAdd
Disallow *VFSearchDisplay*
Disallow *SearchDisplay*
Disallow /shop/VFSearchDisplay
Disallow /webapp/wcs/stores/servlet/SearchDisplay
Disallow /shop/SearchDisplay
Disallow /webapp/wcs/stores/servlet/VFSearchDisplay
Disallow /shop/VFLogoff
Disallow /webapp/wcs/stores/servlet/*iframeDOMWindow%3Dtrue
Disallow /webapp/wcs/stores/servlet/LogonForm
Disallow /webapp/wcs/stores/servlet/OrderItemDisplay
Disallow /webapp/wcs/stores/servlet/TNFContactUsView
Disallow /VFAjaxProductVideoView
Disallow /?CountryPref=
Disallow /*?stop_mobi=

Other Records

Field Value
sitemap https://www.vans.co.uk/.sitemap.xml
sitemap https://www.vans.co.uk/sitemap_10158.xml.gz
sitemap https://www.vans.co.uk/international-gb-sitemap.xml
sitemap https://www.vans.co.uk/ns-eu/vans-eu/sitemaps/vans-international-sitemap-en-gb.xml

Comments

  • robots.txt for http://www.vans.co.uk