Log In Sign Up

apachevape.com
robots.txt

Robots Exclusion Standard data for apachevape.com

Resource Scan

Scan Details

Site Domain apachevape.com
Base Domain apachevape.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-12-31T11:54:50+00:00
Next Scan 2026-03-31T11:54:50+00:00

Last Successful Scan

Scanned2025-05-13T07:32:27+00:00
URL https://apachevape.com/robots.txt
Redirect https://vaporlinq.net/robots.txt
Redirect Domain vaporlinq.net
Redirect Base vaporlinq.net
Domain IPs 46.32.253.213
Redirect IPs 77.72.2.34
Response IP 77.72.2.34
Found Yes
Hash 4d48dbca00e434d26641cdc36d09b39e375f45e48eaa96f08fb108bde3dbace4
SimHash 71b45f0585dd

Groups

*

Rule Path
Disallow /catalogsearch/
Disallow /js/
Disallow /customer/section/

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

webmeup-crawler

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

googlebot

Rule Path
Allow
Disallow /catalogsearch/
Disallow /customer/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /blog/tag/
Disallow /*?p=
Disallow /pub/index.php?
Disallow /js/magestore/
Disallow /js/magestore/affiliateplus/image.php?id=5&account_id=477&store_id=1
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /page_cache/
Disallow /swissupamp/
Disallow /js/
Disallow /*SID%3D
Disallow /*amp%3D

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 120

msnbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

crawler.feedback

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

aibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

webmeup-crawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

seznam

Rule Path
Disallow /

*

Rule Path
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /page_cache/
Disallow /swissupamp/
Disallow /js/
Disallow /*SID%3D
Disallow /*amp%3D
Disallow /pub/index.php?
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /blog/tag/
Disallow /*?p=
Disallow /pub/index.php?q=
Disallow /pub/index.php?
Disallow /js/magestore/affiliateplus/image.php?id=5&account_id=477&store_id=1
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /js/
Disallow /tag/
Disallow /review/
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /RELEASE_NOTES.txt
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /*.git
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Disallow /*.tar
Disallow /*.rar
Disallow /*.php$
Back to top

Comments

  • ****************************************************************************
  • robots.txt
  • : Robots, spiders, and search engines use this file to detmine which
  • content they should *not* crawl while indexing your website.
  • : This system is called "The Robots Exclusion Standard."
  • : It is strongly encouraged to use a robots.txt validator to check
  • for valid syntax before any robots read it!
  • Examples:
  • Instruct all robots to stay out of the admin area.
  • : User-agent: *
  • : Disallow: /admin/
  • Restrict Google and MSN from indexing your images.
  • : User-agent: Googlebot
  • : Disallow: /images/
  • : User-agent: MSNBot
  • : Disallow: /images/
  • ****************************************************************************
  • Disable checkout & customer account
  • Disable Search pages
  • Disable common folders
  • Disallow: /pub/
  • Disable Tag & Review (Avoid duplicate content)
  • Common files
  • Disable sorting (Avoid duplicate content)
  • Disable version control folders and others
Back to top