Log In Sign Up

vanteshop.com
robots.txt

Robots Exclusion Standard data for vanteshop.com

Resource Scan

Scan Details

Site Domain vanteshop.com
Base Domain vanteshop.com
Scan Status Ok
Last Scan2026-01-28T19:51:47+00:00
Next Scan 2026-02-27T19:51:47+00:00

Last Scan

Scanned2026-01-28T19:51:47+00:00
URL https://vanteshop.com/robots.txt
Domain IPs 31.7.65.234
Response IP 31.7.65.234
Found Yes
Hash 5d09c62cecfa48f11267c04c64ad932ce4af3489b54abbfa5ba1002397f02757
SimHash ac191231c291

Groups

*

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /wp-admin/
Disallow /login/
Allow /
Allow /product/
Allow /shop/
Disallow /*?filter=
Disallow /*?color=
Disallow /*?size=
Disallow /*?price=
Disallow /?s=
Disallow /tmp/
Disallow /private/
Back to top

Other Records

Field Value
sitemap https://vanteshop.com/sitemap.xml
Back to top

Comments

  • Block cart, account, and checkout pages that don't need to be crawled
  • Block admin and login pages
  • Allow crawling of the entire website except for disallowed pages
  • Ensure all product pages are indexed
  • Block filtered product URLs to prevent duplicate content
  • Block search results pages
  • Block access to temporary files
  • Reference to sitemap
Back to top