barcodesinc.com
robots.txt

Robots Exclusion Standard data for barcodesinc.com

Resource Scan

Scan Details

Site Domain barcodesinc.com
Base Domain barcodesinc.com
Scan Status Ok
Last Scan2025-12-06T14:41:37+00:00
Next Scan 2026-01-05T14:41:37+00:00

Last Scan

Scanned2025-12-06T14:41:37+00:00
URL https://barcodesinc.com/robots.txt
Redirect https://www.barcodesinc.com/robots.txt
Redirect Domain www.barcodesinc.com
Redirect Base barcodesinc.com
Domain IPs 104.18.16.15, 104.18.17.15, 2606:4700::6812:100f, 2606:4700::6812:110f
Redirect IPs 104.18.16.15, 104.18.17.15, 2606:4700::6812:100f, 2606:4700::6812:110f
Response IP 104.18.16.15
Found Yes
Hash 737fccc8ba3e10f4b9d07a807895e0dc7837441796209ee4eefc08591b7b4cf2
SimHash 47b45ef0e67a

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

badbot

Rule Path
Disallow /

*

Rule Path
Disallow /*/admin/
Disallow /admin/
Disallow /*/admin*
Disallow /api/
Disallow /app/
Disallow /cgi-bin/
Disallow /rest/V1/
Disallow /catalog/
Disallow /composer.json
Disallow /composer.lock
Disallow /CHANGELOG.txt
Disallow /COPYING.txt
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /php.ini
Disallow /error_log
Disallow /errors/
Disallow /*p%3D
Disallow /*filters.*
Disallow /*cat%3D*
Disallow /*filter.
Disallow /add-ons.htm
Disallow /checkout/
Disallow /customer/
Disallow /myaccount/
Disallow /quotes/
Disallow /quotes/quote_this.htm
Disallow /*online_quote_add.php*
Disallow /search-results.htm
Disallow /search.htm?p=
Disallow /search.htm?q=
Disallow /catalogsearch/result/?q
Disallow /news/?author=
Disallow /news/?m=
Disallow /news/?tag=
Disallow /news/tag/
Disallow /partners/
Disallow /review/?pr_page_id=
Disallow /cgi-bin/
Disallow /server-status
Disallow /server-info
Disallow /tmp/
Disallow /var/
Disallow /var/cache/
Disallow /var/composer_home/
Disallow /var/log/
Disallow /var/session/
Disallow /var/tmp/
Disallow /vendor/

Other Records

Field Value
sitemap https://www.barcodesinc.com/media/sitemap/sitemap.xml

Comments

  • DEVELOPMENT RELATED SETTINGS
  • GENERAL MAGENTO SETTINGS
  • Magento Files
  • MAGENTO SEO IMPROVEMENTS
  • Disallow: */*? (Commented out directive)
  • User Account & Checkout Pages
  • Catalog Search Pages
  • Specific CMS Pages & Others
  • Duplicate Content
  • SERVER SETTINGS

Warnings

  • 3 invalid lines.