Log In Sign Up

shahrecomputer.com
robots.txt

Robots Exclusion Standard data for shahrecomputer.com

Resource Scan

Scan Details

Site Domain shahrecomputer.com
Base Domain shahrecomputer.com
Scan Status Ok
Last Scan2025-08-03T12:55:07+00:00
Next Scan 2025-09-02T12:55:07+00:00

Last Scan

Scanned2025-08-03T12:55:07+00:00
URL https://shahrecomputer.com/robots.txt
Domain IPs 195.28.169.89
Response IP 195.28.169.89
Found Yes
Hash b742248b6b56470b1fe4aa2a2f198f11bde821c2c9b05675ce1b6302b0c994b4
SimHash 4c62594bc353

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /readme.html
Disallow /license.txt
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /rss/
Disallow /feed/
Disallow */feed/
Disallow /search/
Disallow /search/*
Disallow /search?q=*
Disallow /faq/*
Disallow /author/
Disallow /archives/
Disallow /my-account/
Disallow /downloads/
Disallow */?*
Disallow *?*
Allow */?ver*
Disallow /*.php$
Disallow /*.html$
Back to top

Other Records

Field Value
sitemap https://shahrecomputer.com/sitemap_index.xml
Back to top

Comments

  • Block unnecessary directories and files
  • Block WordPress admin but allow AJAX requests
  • Block feeds
  • Block search results
  • Block author archives
  • Block date archives
  • Block user accounts
  • Block WooCommerce downloads
  • Block WooCommerce filters, add to cart, and all parameters
  • Block direct access to PHP and HTML files for added security
  • Define the location of your sitemap
Back to top