Log In Sign Up

dermazen.com
robots.txt

Robots Exclusion Standard data for dermazen.com

Resource Scan

Scan Details

Site Domain dermazen.com
Base Domain dermazen.com
Scan Status Ok
Last Scan2025-10-14T23:51:39+00:00
Next Scan 2025-10-28T23:51:39+00:00

Last Scan

Scanned2025-10-14T23:51:39+00:00
URL https://dermazen.com/robots.txt
Redirect https://www.dermazen.com/robots.txt
Redirect Domain www.dermazen.com
Redirect Base dermazen.com
Domain IPs 23.227.38.65, 2606:4700:3031::6815:18b9
Redirect IPs 23.227.38.74, 2620:127:f00f:e::
Response IP 23.227.38.74
Found Yes
Hash 569c94eab0f0b4ba83d9ab82a5deca34c9ab54d80908dad7d0ec7d4a35f5ed79
SimHash bf55cc52cfd3

Groups

*

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /48800858279/checkouts
Disallow /48800858279/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow */collections/*filter*%26*filter*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /recommendations/products
Disallow /*/recommendations/products
Disallow /products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

adsbot-google

Rule Path
Disallow /checkouts/
Disallow /checkout
Disallow /carts
Disallow /orders
Disallow /48800858279/checkouts
Disallow /48800858279/orders
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /cdn/wpm/*.js
Disallow /products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /48800858279/checkouts
Disallow /48800858279/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow */collections/*filter*%26*filter*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /48800858279/checkouts
Disallow /48800858279/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow */collections/*filter*%26*filter*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote
Disallow /*/collections/*/products/*-%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D%5Ba-f0-9%5D-remote

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

Rule Path
Disallow /*tagged*
Disallow /pages/shampoo-vip-confirmation
Disallow /en-ca/pages/reviews
Disallow /products/calm-clear-skin-bundle
Disallow /en-ca/pages/temp-page-title
Disallow /en-ca/account/register
Disallow /products/annual-zen-membership
Disallow /en-ca/account/login
Disallow /pages/facial-cleanser-waiting-list-confirmation
Disallow /en-ca/pages/facial-cleanser-waiting-list-confirmation
Disallow /en-ca/pages/shipping-policy
Disallow /pages/demo-home
Disallow /en-ca/pages/ofr-ld-a0c6qnxy
Disallow /pages/temp-page-title
Disallow /pages/moisturizer-vip-confirmation
Disallow /en-ca/pages/shampoo-waiting-confirmation
Disallow /pages/newsletter-signup
Disallow /pages/shipping-policy
Disallow /en-ca/pages/disrupting-the-biofilm-and-avoiding-oils
Disallow /blogs/oils-to-avoid-if-you-have-seborrheic-dermatitis-dandruff-or-fungal-acne
Disallow /pages/reviews
Disallow /products/loop-sample-product
Disallow /pages/shampoo-waiting-confirmation
Disallow /pages/ofr-ld-a0c6qnxy
Disallow /en-ca/pages/shampoo-vip-confirmation
Disallow /pages/disrupting-the-biofilm-and-avoiding-oils
Disallow /products/complete-peaceful-skin-system-30
Disallow /en-ca/blogs/oils-to-avoid-if-you-have-seborrheic-dermatitis-dandruff-or-fungal-acne
Disallow /en-ca/pages/moisturizer-vip-confirmation
Disallow /en-ca/pages/vitamin-c-vip-confirmation
Disallow /products/silicone-scalp-scrubber
Disallow /en-ca/pages/demo-home
Disallow /en-ca/pages/newsletter-signup
Disallow /pages/vitamin-c-vip-confirmation
Disallow /products/order-protection
Disallow /products/dermatologist-samples-patient-handouts

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.dermazen.com/sitemap.xml
sitemap https://www.dermazen.com/sitemap.xml
sitemap https://www.dermazen.com/sitemap.xml
Back to top

Comments

  • we use Shopify as our ecommerce platform
Back to top