Log In Sign Up

bottleyourbrand.com
robots.txt

Robots Exclusion Standard data for bottleyourbrand.com

Resource Scan

Scan Details

Site Domain bottleyourbrand.com
Base Domain bottleyourbrand.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-21T13:38:06+00:00
Next Scan 2024-12-20T13:38:06+00:00

Last Successful Scan

Scanned2023-08-04T13:40:47+00:00
URL https://bottleyourbrand.com/robots.txt
Domain IPs 172.66.40.145, 172.66.43.111, 2606:4700:3108::ac42:2891, 2606:4700:3108::ac42:2b6f
Response IP 172.66.43.111
Found Yes
Hash 8ec90c8e9d4d9bb712c409c3f7af0a7b5300eb89e51844fe98aa09abffa2067d
SimHash a5a5700987f0

Groups

*

Rule Path
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /STATUS.txt
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login
Disallow /dol
Disallow /dol/ajax/designPreview
Disallow /dol/ajax/designPreviewImage
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /?mode
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /?modes
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /phpserver/
Disallow /pub/
Disallow /tag/
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /*?p=*
Disallow /*%26dir%3Ddesc*
Disallow /*?amp*
Disallow /*?%3B*
Disallow /*%26limit%3D*
Disallow /*?order=*
Disallow /cgi-bin/
Disallow /cleanup.php
Disallow /apc.php
Disallow /memcache.php
Disallow /phpinfo.php
Disallow /*.git
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Disallow /search_landing/
Disallow /*account/
Disallow /*tags/
Disallow /*tag/
Disallow /index.php/
Disallow /control/
Disallow /contacts/
Disallow /customize/
Disallow /newsletter/
Disallow /poll/
Disallow /wishlist/
Disallow /catalog/product/gallery/
Disallow /404/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /magento/
Disallow /scripts/
Disallow /shell/
Disallow /skin/
Disallow /stats/
Disallow /RELEASE_NOTES.txt
Disallow /RELEASE_NOTES.txts
Back to top

Other Records

Field Value
sitemap https://bottleyourbrand.com/sitemaps/sitemap-1-2.xml
sitemap https://bottleyourbrand.com/sitemaps/sitemap-1-1.xml
sitemap https://bottleyourbrand.com/sitemaps/sitemap.xml
sitemap https://bottleyourbrand.com/blog/sitemap-archives.xml
sitemap https://bottleyourbrand.com/blog/sitemap.xml
Back to top

Comments

  • Default instructions:
  • Disallow common Magento files in the root directory:
  • Disallow User Account & Checkout Pages:
  • Disallow Catalog Search Pages:
  • Disallow URL Filter Searches
  • Restrict Common files
  • Disallow CMS Directories:
  • Disallow Duplicate Content:
  • Disallow general technical directories and files on a server
  • Disallow version control folders and others
  • Disallow Custom Page for google crawling
  • Paths (clean URLs)
  • Disallow: /checkout/
  • Disallow: /*.js$
  • Disallow: /*.css$
  • Directories
  • Disallow: /js/
  • Disallow: /lib/
  • Disallow: /media/
  • Common files
  • Restrict Technical Magento Files
  • Restrict Common file
  • Sitemap that need to crawl by search engine
Back to top

Warnings

  • 12 invalid lines.
Back to top