vans.lu
robots.txt
Robots Exclusion Standard data for vans.lu
Resource Scan
Scan Details
Site Domain | vans.lu |
Base Domain | vans.lu |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-08-28T20:48:34+00:00 |
Next Scan | 2025-11-26T20:48:34+00:00 |
Last Successful Scan
Scanned | 2024-07-12T20:45:40+00:00 |
URL | https://vans.lu/robots.txt |
Redirect | https://www.vans.lu/robots.txt |
Redirect Domain | www.vans.lu |
Redirect Base | vans.lu |
Domain IPs | 23.37.43.106 |
Redirect IPs | 118.215.82.31 |
Response IP | 104.69.45.152 |
Found | Yes |
Hash | e75c65a3e21ce52846bd0dffb6212e3fd1375390b9d97ee7950be4835c521f6d |
SimHash | 071b4f8a4573 |
Groups
*
Rule | Path |
---|---|
Disallow | /shop/CompareProductsDisplay |
Disallow | /shop/OrderCalculate |
Disallow | /shop/InterestItemAdd |
Disallow | *VFSearchDisplay* |
Disallow | *SearchDisplay* |
Disallow | /shop/VFSearchDisplay |
Disallow | /webapp/wcs/stores/servlet/SearchDisplay |
Disallow | /shop/SearchDisplay |
Disallow | /webapp/wcs/stores/servlet/VFSearchDisplay |
Disallow | /shop/VFLogoff |
Disallow | /webapp/wcs/stores/servlet/*iframeDOMWindow%3Dtrue |
Disallow | /webapp/wcs/stores/servlet/LogonForm |
Disallow | /webapp/wcs/stores/servlet/OrderItemDisplay |
Disallow | /webapp/wcs/stores/servlet/TNFContactUsView |
Disallow | /VFAjaxProductVideoView |
Disallow | /?CountryPref= |
Disallow | /*?stop_mobi= |
Other Records
Field | Value |
---|---|
sitemap | https://www.vans.lu/.sitemap.xml |
sitemap | https://www.vans.lu/sitemap_10170.xml.gz |
Comments