Log In Sign Up

structech.ir
robots.txt

Robots Exclusion Standard data for structech.ir

Resource Scan

Scan Details

Site Domain structech.ir
Base Domain structech.ir
Scan Status Ok
Last Scan2025-07-06T13:01:37+00:00
Next Scan 2025-08-05T13:01:37+00:00

Last Scan

Scanned2025-07-06T13:01:37+00:00
URL https://structech.ir/robots.txt
Domain IPs 195.28.10.31
Response IP 195.28.10.31
Found Yes
Hash 22e3cf6df1f512c6602cb93df0c387416ec768acc0f3542b1f854674b07dfc0e
SimHash 608aca02e593

Groups

*

Rule Path Comment
Disallow /*?order -
Disallow /*?add-to-cart -
Disallow /*?orderby -
Disallow /wp-admin/ -
Disallow /wp-includes/ -
Disallow /cart/ -
Disallow /checkout/ -
Disallow /my-account/ -
Disallow /?s= Block search results
Allow /wp-admin/admin-ajax.php -
Allow /wp-content/uploads/ -
Allow /wp-content/themes/ -
Allow /wp-content/plugins/ -

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.structech.ir/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Block unnecessary URL parameters
  • Block sensitive areas
  • Allow Googlebot to crawl CSS, JS for proper page rendering
  • Sitemap location
  • ---------------------------
  • END YOAST BLOCK
  • Specific directives for major search engines
Back to top