goldentech.com.sa
robots.txt

Robots Exclusion Standard data for goldentech.com.sa

Resource Scan

Scan Details

Site Domain goldentech.com.sa
Base Domain goldentech.com.sa
Scan Status Ok
Last Scan2025-09-24T00:02:35+00:00
Next Scan 2025-10-24T00:02:35+00:00

Last Scan

Scanned2025-09-24T00:02:35+00:00
URL https://goldentech.com.sa/robots.txt
Domain IPs 104.16.172.24, 104.16.173.24
Response IP 104.16.173.24
Found Yes
Hash cfd55f8af1c5c17f8f36412519bf5b54d4c0d002bcf5d9dd3015783f0b8b6424
SimHash cb8c504105fa

Groups

*

Rule Path Comment
Disallow /checkout/ -
Disallow /customer/ -
Disallow /catalogsearch/ -
Disallow /compare/ -
Disallow /review/ -
Disallow /sendfriend/ -
Disallow /wishlist/ -
Disallow /search/ if your theme adds a /search/ path
Disallow /index.php/ old style direct paths
Disallow /*?*dir= -
Disallow /*?*order= -
Disallow /*?*mode= -
Disallow /*?*limit= -
Disallow /*?*price= -
Disallow /*?*color= -
Disallow /*?*size= -
Disallow /*?*SID= -
Allow /static/ -
Allow /media/ -
Allow /*.css$ -
Allow /*.js$ -
Allow /*.png$ -
Allow /*.jpg$ -
Allow /*.jpeg$ -
Allow /*.webp$ -
Allow /*.svg$ -

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://goldentech.com.sa/sitemap.xml

Comments

  • Block high-load, low-value areas
  • Block layered navigation / faceted URLs & common duplicates (keep canonical pages)
  • Ensure resources stay crawlable for proper rendering
  • Optional: slow down non-Google crawlers that respect Crawl-delay