Log In Sign Up

theoringstore.com
robots.txt

Robots Exclusion Standard data for theoringstore.com

Resource Scan

Scan Details

Site Domain theoringstore.com
Base Domain theoringstore.com
Scan Status Ok
Last Scan2024-11-13T17:54:07+00:00
Next Scan 2024-12-13T17:54:07+00:00

Last Scan

Scanned2024-11-13T17:54:07+00:00
URL https://theoringstore.com/robots.txt
Domain IPs 104.26.14.12, 104.26.15.12, 172.67.74.67, 2606:4700:20::681a:e0c, 2606:4700:20::681a:f0c, 2606:4700:20::ac43:4a43
Response IP 104.26.15.12
Found Yes
Hash b6831ae7d3b03cab126e3248b186d120c7f5fc139521729a56aadf658b7d1d24
SimHash dc5151262c51

Groups

*

Rule Path
Disallow /cgi-bin/

ahrefsbot

Rule Path
Disallow /

ahrefsbot/2.0

Rule Path
Disallow /

ahrefsbot/4.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

jakarta commons-httpclient/3.0

Rule Path
Disallow /
Back to top

Comments

  • NOTE: This is only an example file.
  • If you don't already have a robots.txt file, you may RENAME this one to robots.txt
  • **** IF YOU USE THIS SAMPLE FILE **** ... THEN YOU SHOULD remove all comments from this file simply by deleting any lines starting with a
  • ***** Zen Cart doesn't require any specific exclusions for normal operation of Zen Cart activities. *****
  • ***** You can fine-tune or customize things according to your own needs related to search-engine results, but that is entirely outside the scope of normal Zen Cart operation. *****
  • If you wish to prevent indexing of your /images folder, add a line that says:
  • Disallow: /images
  • (but remove the # from the beginning of the line! )
  • And if you wish your popup pages to not be indexed, you can add this also:
  • Disallow: /index.php?main_page=popup_image*
  • (again, remove the # )
  • Do not list any private folders here ... otherwise their existence is no longer private.
  • Your robots.txt file should go in your /public_html or /httpdocs folder,
  • (even if your Zen Cart installation might be in a subfolder). Adjust any folder paths accordingly.
  • For additional reference on settings for robots.txt files, refer to:
  • http://www.robotstxt.org/wc/exclusion.html
  • http://en.wikipedia.org/wiki/Robots.txt
  • * Example robots.txt file
  • * @package main
  • * @access private
  • * @copyright Copyright 2003-2010 Zen Cart Development Team
  • * @license http://www.zen-cart.com/license/2_0.txt GNU Public License V2.0
  • * @version $Id: robots_example.txt 18944 2011-06-14 15:53:46Z drbyte $
  • AhrefsBot
  • AhrefsBot/2.0
  • AhrefsBot/4.0
  • majestic
  • YodaoBot
  • Jakarta Commons-HttpClient/3.0
Back to top