candere.com
robots.txt

Robots Exclusion Standard data for candere.com

Resource Scan

Scan Details

Site Domain candere.com
Base Domain candere.com
Scan Status Ok
Last Scan2024-09-08T06:34:20+00:00
Next Scan 2024-10-08T06:34:20+00:00

Last Scan

Scanned2024-09-08T06:34:20+00:00
URL https://candere.com/robots.txt
Redirect https://www.candere.com/robots.txt
Redirect Domain www.candere.com
Redirect Base candere.com
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.45.124
Found Yes
Hash 2fabbe1b7fdfd353abc4ffbe5117cdc954624c2a13d0d508dccbcac8c33b83b3
SimHash e826e0024a91

Groups

*

Rule Path
Disallow /us
Disallow old.candere.com
Disallow /homepage-new.html
Disallow /static/version*/frontend/Codilar/candere_desktop/en_US/js/bundle/
Disallow /static/version*/frontend/Codilar/candere_mobile/en_US/js/bundle/
Disallow /static/version*/frontend/Codilar/candere/en_US/js/bundle/
Disallow /*?
Disallow /?s=
Disallow /?__SID=U
Disallow /*?p=
Disallow /*%26p%3D
Disallow /*?price=
Disallow /shop-by/
Disallow /*%26price%3D
Disallow /*?color=
Disallow /*%26color%3D
Disallow /*?limit=
Disallow /*%26limit%3D
Disallow /*?order=
Disallow /*%26order%3D
Disallow /*?dir=
Disallow /*?utm_source=
Disallow /*%26dir%3D
Disallow /where/
Disallow /w/
Disallow /checkout/
Disallow /searchsolitaire/
Disallow /tag/
Disallow /app/
Disallow /cgi-bin/
Disallow /includes/
Disallow /downloader/
Disallow /lib/
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /ebay/
Disallow /ebaypics/
Disallow /generator/
Disallow /fules/
Disallow /candere_report/
Disallow /custom/
Disallow /Modaka/
Disallow /ebaypics/
Disallow /*.php$
Disallow /*?SID=
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?order*
Disallow /*?order=created_at*
Disallow /*?order=position*
Disallow /*?order=price*
Disallow /camweara/index.php?
Disallow /gamooga/
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /*?PageSpeed=noscript
Disallow /index.php/*
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/result/index/
Disallow /sendcustomdata/index/getnewarrivals/
Disallow /catalogsearch/result/
Disallow /catalogsearch/
Disallow /checkout/*
Disallow /checkout/cart
Disallow /checkout/cart/
Disallow /productajaxload/*
Disallow /control/
Disallow /contacts/
Disallow /customer/
Disallow /customize/
Disallow /directory/*
Disallow /vitualdrive/*
Disallow /newsletter/
Disallow /directory/currency/switch/currency/GBP/uenc/*
Disallow /directory/currency/switch/currency/AUD/uenc/*
Disallow /directory/currency/switch/currency/EUR/uenc/*
Disallow /directory/currency/switch/currency/SGD/uenc/*
Disallow /directory/currency/switch/currency/USD/uenc/*
Disallow /directory/currency/switch/currency/INR/uenc/*
Disallow /directory/currency/switch/currency/CAD/uenc/*
Allow /*.js$
Allow /*.css$

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.candere.com/sitemap.xml
sitemap https://www.candere.com/media/sitemap_category/sitemap_category.xml
sitemap https://www.candere.com/media/sitemap_category/sitemap_product.xml
sitemap https://www.candere.com/media/sitemap_category/sitemap_platinum.xml
sitemap https://www.candere.com/media/sitemap_category/sitemap_gold.xml
sitemap https://www.candere.com/media/sitemap_category/sitemap_diamond.xml
sitemap https://www.candere.com/media/sitemap_category/sub_category_pages.xml
sitemap https://www.candere.com/media/sitemap_category/sitemap_blog.xml
sitemap https://www.candere.com/media/sitemap_category/sitemap_cms.xml
sitemap https://www.candere.com/media/sitemap_category/sitemap_gold_rate_page.xml
sitemap https://www.candere.com/media/sitemap_product/sitemap_video.xml
sitemap https://www.candere.com/media/sitemap_category/webstories.xml

Comments

  • Do not crawl sub category pages that are sorted or filtered.
  • Files
  • Paths (clean URLs)
  • Allow all files ending with these extensions