mall.shopee.com.my
robots.txt

Robots Exclusion Standard data for mall.shopee.com.my

Resource Scan

Scan Details

Site Domain mall.shopee.com.my
Base Domain shopee.com.my
Scan Status Ok
Last Scan2026-03-04T06:15:34+00:00
Next Scan 2026-03-11T06:15:34+00:00

Last Scan

Scanned2026-03-04T06:15:34+00:00
URL https://mall.shopee.com.my/robots.txt
Domain IPs 202.181.90.194
Response IP 147.136.175.194
Found Yes
Hash 60bc575162ccd7c59a06e264017da96960585af354454ac508f11795eeb1ad35
SimHash 7610e216790c

Groups

googlebot
googlebot-mobile
bingbot

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /buyer/login/otp
Disallow /user/
Disallow /me/
Disallow /order/
Disallow /daily_discover/
Disallow /mall/just-for-you/
Disallow /mall/*-cat.
Disallow /from_same_shop/
Disallow /you_may_also_like/
Disallow *-i.*/similar?from=flash_sale
Disallow /find_similar_products/
Disallow /top_products
Disallow /search*searchPrefill
Disallow /index.html
Disallow /search*hashtag%3D
Disallow /search?shop=
Disallow /buyer/*/rating/
Disallow *-cat.*?category=
Disallow /shop/*/search
Disallow /shop/*/details
Disallow /search/?
Disallow /search?brands=
Disallow /search?originalCategoryId=
Disallow /addon-deal-selection/
Disallow /bundle-deal/
Disallow /*?*sp_atk=
Disallow *__classic__%3D1
Disallow /search_user
Disallow /blog/?s=
Disallow *utm_source
Disallow /search*.com
Disallow /search*%C3%82%C2%B7asia
Disallow /search*.tv
Disallow /search*.xyz
Disallow /search*%C3%82%C2%B7COM
Disallow /search*%C3%A5%C2%A6%C2%B9
Disallow /search*%C3%A9
Disallow /search*%C3%A5
Disallow /*?*srsltid
Disallow /search*TF88
Disallow /search*TF99

Other Records

Field Value
crawl-delay 0.1

*

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /buyer/login/otp
Disallow /user/
Disallow /me/
Disallow /order/
Disallow /daily_discover/
Disallow /mall/just-for-you/
Disallow /mall/*-cat.
Disallow /from_same_shop/
Disallow /you_may_also_like/
Disallow *-i.*/similar
Disallow /find_similar_products/
Disallow /top_products
Disallow /search*searchPrefill
Disallow /index.html

Other Records

Field Value
crawl-delay 1

Warnings

  • 29 invalid lines.