Log In Sign Up

gshindustries.com
robots.txt

Robots Exclusion Standard data for gshindustries.com

Resource Scan

Scan Details

Site Domain gshindustries.com
Base Domain gshindustries.com
Scan Status Ok
Last Scan2025-09-02T02:49:06+00:00
Next Scan 2025-10-02T02:49:06+00:00

Last Scan

Scanned2025-09-02T02:49:06+00:00
URL https://gshindustries.com/robots.txt
Domain IPs 96.127.180.42
Response IP 96.127.180.42
Found Yes
Hash e168819e5ac5342ffeb9b60524d2ab4f54ac5aec9bc4e4b2f45de177a0cb6fcd
SimHash 6d00589f2633

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/cache/
Disallow /wp-content/uploads/cache/
Disallow /wp-content/upgrade/
Disallow /wp-content/backup-db/
Disallow /wp-content/backups/
Disallow /wp-content/blogs.dir/
Disallow /wp-content/upgrade/
Disallow /wp-content/uploads/backup/
Disallow /wp-content/uploads/backups/
Disallow /wp-config.php
Disallow /wp-config-sample.php
Disallow /wp-settings.php
Disallow /wp-cron.php
Disallow /wp-links-opml.php
Disallow /wp-load.php
Disallow /wp-login.php
Disallow /wp-mail.php
Disallow /wp-trackback.php
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /license.txt
Disallow /error_log
Disallow /.htaccess
Disallow /.htpasswd
Disallow /sitemap.xml.gz
Disallow /sitemap.xml
Disallow /search
Disallow /?s=
Disallow /feed/
Disallow /rss/
Disallow /rss2/
Disallow /rdf/
Disallow /atom/
Disallow /comments/feed/
Disallow /author/
Disallow /tag/
Disallow /category/
Disallow /20*/
Disallow /19*/
Disallow /page/
Disallow /paged/
Disallow /trackback/
Disallow /comment-page-
Disallow /comments/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /login/
Disallow /register/
Disallow /maintenance/
Disallow /maintenance.html
Disallow /maintenance.php
Allow /wp-content/uploads/
Allow /wp-content/themes/*/style.css
Allow /wp-content/themes/*/screenshot.png
Allow /wp-content/plugins/*/readme.txt
Back to top

Other Records

Field Value
sitemap https://www.gshindustries.com/sitemap.xml
Back to top

Comments

  • Block access to admin areas
  • Block access to WordPress core files
  • Block access to sensitive files
  • Block access to search and feeds
  • Block access to author pages (optional - remove if you want author pages indexed)
  • Block access to tag pages (optional - remove if you want tag pages indexed)
  • Block access to category pages (optional - remove if you want category pages indexed)
  • Block access to date archives (optional - remove if you want date archives indexed)
  • Block access to pagination
  • Block access to trackbacks and comments
  • Block access to login and registration
  • Block access to maintenance files
  • Allow access to important files
  • Sitemap location
  • Crawl-delay (optional - adjust based on your server capacity)
  • Crawl-delay: 1
Back to top