yongsheng.com.my
robots.txt

Robots Exclusion Standard data for yongsheng.com.my

Resource Scan

Scan Details

Site Domain yongsheng.com.my
Base Domain yongsheng.com.my
Scan Status Ok
Last Scan2025-10-29T16:39:48+00:00
Next Scan 2025-11-28T16:39:48+00:00

Last Scan

Scanned2025-10-29T16:39:48+00:00
URL https://yongsheng.com.my/robots.txt
Domain IPs 104.21.34.75, 172.67.156.28, 2606:4700:3030::ac43:9c1c, 2606:4700:3032::6815:224b
Response IP 104.21.34.75
Found Yes
Hash 07407137f84f1ccec4b278cec5fca760e543285d65ea398f6aa85a9d5ec3d095
SimHash e690d902a129

Groups

*

Rule Path
Allow /
Disallow /login
Disallow /register
Disallow /checkout
Disallow /shopping-cart
Disallow /my-account
Disallow /my-account-address
Disallow /my-account-orders
Disallow /my-account-orders-details
Disallow /wish-list
Disallow /order
Disallow /search-result
Allow /product-*
Allow /shop-*
Allow /home-*
Allow /about
Allow /contact
Allow /faqs
Allow /store-list
Allow /term-of-use
Allow /blog-*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://yongsheng.com.my/sitemap.xml

Comments

  • Block user account and private pages
  • Block search result pages to avoid duplicate content
  • Allow product and shop pages
  • Sitemap location
  • Crawl delay to prevent server overload