Log In Sign Up

kiehls.com
robots.txt

Robots Exclusion Standard data for kiehls.com

Resource Scan

Scan Details

Site Domain kiehls.com
Base Domain kiehls.com
Scan Status Ok
Last Scan2026-01-08T02:24:52+00:00
Next Scan 2026-02-07T02:24:52+00:00

Last Scan

Scanned2026-01-08T02:24:52+00:00
URL https://kiehls.com/robots.txt
Redirect https://www.kiehls.com/robots.txt
Redirect Domain www.kiehls.com
Redirect Base kiehls.com
Domain IPs 104.18.42.180, 172.64.145.76, 2606:4700:4400::6812:2ab4, 2606:4700:4401::ac40:914c
Redirect IPs 104.18.42.180, 172.64.145.76, 2606:4700:4400::6812:2ab4, 2606:4700:4401::ac40:914c
Response IP 172.64.145.76
Found Yes
Hash 2bf8293dabe17dfb7579b2b10dc4d7e8a5fcb1ded19f34bdf1fcdf2a04074456
SimHash f1d2525490b3

Groups

*

Rule Path
Disallow /*Address-List
Disallow /*account
Disallow /*boxes
Disallow /*cart
Disallow /*checkout-start
Disallow /*gift-wrapping
Disallow /*Order-History
Disallow /*register
Disallow /*sale
Disallow /*samples
Disallow /*search
Disallow /*shopping-bag
Disallow /*Wishlist-Show
Disallow /all-about-kiehls-retinol-serums-new.html
Disallow /*/Sites-kiehls_us-Site/*/Account
Disallow /*/Sites-kiehls_us-Site/*/__SYSTEM__Page-Render
Disallow /*/Sites-kiehls_us-Site/*/Address
Disallow /*/Sites-kiehls_us-Site/*/AddToCartNotification
Disallow /*/Sites-kiehls_us-Site/*/AutoReplenishment
Disallow /*/Sites-kiehls_us-Site/*/Bazaarvoice
Disallow /*/Sites-kiehls_us-Site/*/Cart
Disallow /*/Sites-kiehls_us-Site/*/COBilling
Disallow /*/Sites-kiehls_us-Site/*/COCheckout
Disallow /*/Sites-kiehls_us-Site/*/Community-ShowQuestions
Disallow /*/Sites-kiehls_us-Site/*/Compare
Disallow /*/Sites-kiehls_us-Site/*/COSamples
Disallow /*/Sites-kiehls_us-Site/*/COShipping
Disallow /*/Sites-kiehls_us-Site/*/COUtils
Disallow /*/Sites-kiehls_us-Site/*/CRMPopup
Disallow /*/Sites-kiehls_us-Site/*/CustomerService-ContactUs
Disallow /*/Sites-kiehls_us-Site/*/Default-Startcode
Disallow /*/Sites-kiehls_us-Site/*/GenericForm
Disallow /*/Sites-kiehls_us-Site/*/GeoIP
Disallow /*/Sites-kiehls_us-Site/*/GiftCert-ShowMiniCart
Disallow /*/Sites-kiehls_us-Site/*/GiftCert-Edit
Disallow /*/Sites-kiehls_us-Site/*/GiftRegistry
Disallow /*/Sites-kiehls_us-Site/*/Link-Product
Disallow /*/Sites-kiehls_us-Site/*/Login-UtilityLogin
Disallow /*/Sites-kiehls_us-Site/*/Loyalty
Disallow /*/Sites-kiehls_us-Site/*/MyAccount
Disallow /*/Sites-kiehls_us-Site/*/mSearch-Show
Disallow /*/Sites-kiehls_us-Site/*/Newsletter
Disallow /*/Sites-kiehls_us-Site/*/Order-Sampled
Disallow /*/Sites-kiehls_us-Site/*/Page-Include
Disallow /*/Sites-kiehls_us-Site/*/Paymetric
Disallow /*/Sites-kiehls_us-Site/*/Paypal
Disallow /*/Sites-kiehls_us-Site/*/PaymentInstruments
Disallow /*/Sites-kiehls_us-Site/*/PrepareCO-BackToCartRewards
Disallow /*/Sites-kiehls_us-Site/*/PromoBanner-PromoLogin
Disallow /*/Sites-kiehls_us-Site/*/Product-GetAvailability
Disallow /*/Sites-kiehls_us-Site/*/Product-GetBonusProducts
Disallow /*/Sites-kiehls_us-Site/*/Product-GetDWRecommendations
Disallow /*/Sites-kiehls_us-Site/*/Product-GetSamples
Disallow /*/Sites-kiehls_us-Site/*/Product-GetSetItem
Disallow /*/Sites-kiehls_us-Site/*/Product-GetVariants
Disallow /*/Sites-kiehls_us-Site/*/Product-ProductPagination
Disallow /*/Sites-kiehls_us-Site/*/Product-ImageZoom
Disallow /*/Sites-kiehls_us-Site/*/Product-RecsTile
Disallow /*/Sites-kiehls_us-Site/*/Product-Show/C
Disallow /*/Sites-kiehls_us-Site/*/Product-ShowInCategory
Disallow /*/Sites-kiehls_us-Site/*/Product-UpdateMail
Disallow /*/Sites-kiehls_us-Site/*/Product-Variation
Disallow /*/Sites-kiehls_us-Site/*/ProductCustom-GetQAContent
Disallow /*/Sites-kiehls_us-Site/*/PXRedirect
Disallow /*/Sites-kiehls_us-Site/*/Recommendations-Show
Disallow /*/Sites-kiehls_us-Site/*/RemoteIncludeUtil
Disallow /*/Sites-kiehls_us-Site/*/Replenishment-Start
Disallow /*/Sites-kiehls_us-Site/*/Reviews
Disallow /*/Sites-kiehls_us-Site/*/SendToFriend
Disallow /*/Sites-kiehls_us-Site/*/ShopRunner
Disallow /*/Sites-kiehls_us-Site/*/SiteSearchSuggestions
Disallow /*/Sites-kiehls_us-Site/*/Search-ShowContent/C
Disallow /*/Sites-kiehls_us-Site/*/Stores-Find
Disallow /*/Sites-kiehls_us-Site/*/Wishlist
Disallow /*/Sites-kiehls_us-Site/*/Wi%C3%A1%C2%B9%C2%A1list-AddFavorite
Disallow /*bvrrp
Disallow /*bvstate
Disallow /*dwcont
Disallow /*format
Disallow /*gclid
Disallow /*linksrc
Disallow /*pmin
Disallow /*pmax
Disallow /*srule
Disallow /*subid
Disallow /*sz
Disallow /*utm
Disallow /*variantID
Disallow /*_pxhc
Allow /dw/image/v2/AANG_PRD/

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.kiehls.com/sitemap_index.xml
Back to top

Comments

  • Account Pages
  • Backend Disallows
  • Parameter Pages
  • Images allow
Back to top