Log In Sign Up

tomatoink.com
robots.txt

Robots Exclusion Standard data for tomatoink.com

Resource Scan

Scan Details

Site Domain tomatoink.com
Base Domain tomatoink.com
Scan Status Ok
Last Scan2024-06-07T18:01:21+00:00
Next Scan 2024-07-07T18:01:21+00:00

Last Scan

Scanned2024-06-07T18:01:21+00:00
URL https://tomatoink.com/robots.txt
Redirect https://www.tomatoink.com:443/robots.txt
Redirect Domain www.tomatoink.com
Redirect Base tomatoink.com
Domain IPs 13.224.14.122, 13.224.14.53, 13.224.14.62, 13.224.14.69
Redirect IPs 13.226.210.114, 13.226.210.29, 13.226.210.33, 13.226.210.81
Response IP 3.160.246.66
Found Yes
Hash 341fb32ddd1d986cadc73f4368d110bc7c66364c93a65fc5e53d71d7f01bfe8c
SimHash a5607313e6f0

Groups

*

Rule Path
Disallow /CVS
Disallow /*.svn$
Disallow /*.idea$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.csv$
Disallow /*.xls$
Disallow /admin/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /includes/
Disallow /lib/
Disallow /pkginfo/
Disallow /shell/
Disallow /var/
Disallow /download/
Disallow /code/
Disallow /cron/
Disallow /dev/
Disallow /generated/
Disallow /patches/
Disallow /phpserver/
Disallow /setup/
Disallow /update/
Disallow /vendor/
Disallow /api.php
Disallow /cron.php
Disallow /cron.sh
Disallow /error_log
Disallow /get.php
Disallow /install.php
Disallow /elb_health_check.php
Disallow /health_check.php
Disallow /LICENSE.html
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /README.txt
Disallow /RELEASE_NOTES.txt
Disallow /*?*dir=*
Disallow /*?*search_return=*
Disallow /*?*res_per_page=*
Disallow /*?*display_type=*
Disallow /*?*__store=*
Disallow /*?*SID=
Disallow /checkout
Disallow /customer/
Disallow /nsearch/
Disallow /catalogsearch/result/
Disallow /catalog/product/view/
Disallow /catalog/category/view/
Disallow /cgi-bin/
Disallow /cleanup.php
Disallow /apc.php
Disallow /memcache.php
Disallow /phpinfo.php
Disallow /captcha/refresh/
Disallow /order-tracking/index/checkorderbyemail/
Disallow /order-tracking/index/checkorderbyzip/
Disallow /ajaxlogin/index/login/
Disallow /ajaxlogin/index/create/
Disallow /ajaxlogin/index/forgotpassword/
Disallow /ajaxlogin/index/logout/
Disallow /emailcontact
Disallow /findink/index/ajaxprinters
Disallow /findink/index/ajaxcartridges
Disallow /amp/json/
Back to top

Other Records

Field Value
sitemap https://www.tomatoink.com/sitemap.xml
sitemap https://www.tomatoink.com/sitemap/sitemap_ti_en-2-static.xml
sitemap https://www.tomatoink.com/sitemap/sitemap_ti_en-2-category.xml
sitemap https://www.tomatoink.com/sitemap/sitemap_ti_en-2-product.xml
sitemap https://www.tomatoink.com/sitemap/sitemap_ti_en-2-custom.xml
Back to top

Comments

  • robots.txt for Magento 2 Community
  • GENERAL SETTINGS
  • Enable robots.txt rules for all crawlers
  • Magento sitemap: uncomment and replace the URL to your Magento sitemap file
  • DEVELOPMENT RELATED SETTINGS
  • Do not crawl development files and folders: CVS, svn directories and dump files
  • GENERAL MAGENTO SETTINGS
  • Do not crawl Magento admin page
  • Do not crawl common Magento technical folders
  • Do not crawl common Magento files
  • MAGENTO SEO IMPROVEMENTS
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl 2-nd home page copy (example.com/index.php/). Uncomment it only if you activated Magento SEO URLs.
  • Disallow: /index.php/
  • Do not crawl links with session IDs
  • Do not crawl checkout and user account pages
  • Do not crawl site search result page
  • Do not crawl the non-optimized catalog pages
  • SERVER SETTINGS
  • Do not crawl common server technical folders and files
  • Script Files
  • AMP JSON
Back to top