camelbak.com
robots.txt

Robots Exclusion Standard data for camelbak.com

Resource Scan

Scan Details

Site Domain camelbak.com
Base Domain camelbak.com
Scan Status Ok
Last Scan2025-10-10T21:57:06+00:00
Next Scan 2025-11-09T21:57:06+00:00

Last Scan

Scanned2025-10-10T21:57:06+00:00
URL https://camelbak.com/robots.txt
Redirect https://www.camelbak.com/robots.txt
Redirect Domain www.camelbak.com
Redirect Base camelbak.com
Domain IPs 13.35.37.12, 13.35.37.20, 13.35.37.4, 13.35.37.92
Redirect IPs 104.16.47.245, 104.17.32.135
Response IP 104.17.32.135
Found Yes
Hash 9b34ed3cd2141acb15919487d10261145fa505da568dfac2e4a944f9d2ca9bf0
SimHash 6a14731aecf9

Groups

*

Rule Path
Disallow /Account-PasswordResetDialogForm*
Disallow /Account-PasswordReset*
Disallow /cart*
Disallow /Cart-Show*
Disallow /checkout*
Disallow /my-account*
Disallow /my-company*
Disallow /search*
Disallow /account*
Disallow /register*
Disallow /wishlist*
Disallow /payment*
Disallow /billing*
Disallow /order*
Disallow /Product-Variation
Disallow /Search-Show
Disallow /on/demandware.store/*
Disallow /recall*
Disallow /Customizer-Show*
Disallow /*dwvar*

cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.camelbak.com/sitemap_index.xml
sitemap https://www.camelbak.com/sitemap_1-category.xml
sitemap https://www.camelbak.com/sitemap_0-product.xml

Comments

  • For all robots
  • Block access to specific groups of pages
  • to disallow dwvar parameter
  • Allow search crawlers to discover the sitemap
  • Index page
  • Category pages
  • Product Pages
  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • allow Google Shopping
  • allow Google Shopping
  • allow Google Shopping