Log In Sign Up

royaltigergear.com
robots.txt

Robots Exclusion Standard data for royaltigergear.com

Resource Scan

Scan Details

Site Domain royaltigergear.com
Base Domain royaltigergear.com
Scan Status Ok
Last Scan2024-05-20T23:12:37+00:00
Next Scan 2024-05-27T23:12:37+00:00

Last Scan

Scanned2024-05-20T23:12:37+00:00
URL https://royaltigergear.com/robots.txt
Domain IPs 104.21.64.130, 172.67.185.214, 2606:4700:3031::6815:4082, 2606:4700:3035::ac43:b9d6
Response IP 104.21.64.130
Found Yes
Hash 97a909f2e5c9bd7066ae94fcdad241dd511f893f02989422ca39274cd963b48c
SimHash bc765953cfd4

Groups

*

Rule Path
Disallow /admin
Disallow /account.php
Disallow /advanced_search.php
Disallow /checkout_shipping.php
Disallow /create_account.php
Disallow /login.php
Disallow /login.php
Disallow /password_forgotten.php
Disallow /popup_image.php
Disallow /shopping_cart.php
Disallow /product_reviews_write.php
Disallow /cookie_usage.php
Back to top

Comments

  • Sample robots.txt file (make sure the filename is ALL LOWERCASE on Linux/Unix systems)
  • This file should go in your web site's ROOT directory
  • The root directory is where your site's main /index.html file would be found
  • It is usually found in /yourhomedir/public_html/ or /yourhomedir/httpdocs
  • Where "yourhomedir" is your user account's name
  • We invite you to also check out our popular contribution: Simple Template System (STS)
  • It lets you layout or change your OSC look-and-feel by modifying a single HTML file
  • http://www.oscommerce.com/community/contributions,1524 or SimpleTemplateSystem.com
  • Enjoy! - Brian Gallagher @ DiamondSea.com
  • This says to apply these settings to ALL search engine spiders/crawlers
  • These settings will keep spiders from indexing your unwanted pages
  • This assumes that your OSC install is in your web site's ROOT directory
  • ie: http://www.yoursite.com/index.php <- Use if this brings up your OSC main page
  • Feel free to add any other pages on your site that you don't want to be indexed by
  • the search engines.
  • PLEASE NOTE: Any pages that you list here should be secured by other means if you
  • don't want people to be able to view them, as some malicious users will look at a
  • robots.txt file to try to find "hidden" or "secret" areas of web sites to find
  • confidential information.
  • Just Uncomment a line or add new ones as you see fit.
  • Disallow: /private
  • Disallow: /hidden
  • IF YOU DO NOT WISH TO HAVE THE GOOGLE IMAGE BOT SCAN YOUR DOMAIN FOR IMAGES
  • THEN YOU CAN INCLUDE THE FOLLOWING IN YOUR ROBOTS FILE.
  • I FOUND THAT MY BANDWIDTH USAGE DROPPED BY A MASSIVE AMOUNT AFTER I GOT RID
  • OF THE GOOGLE IMAGE BOT. ALL I HAD WAS IMAGE HUNTERS STEALING PRODUCT SHOTS
  • AND NOT EVEN BROWSING THE SITE.
Back to top