mall.shopee.tw
robots.txt

Robots Exclusion Standard data for mall.shopee.tw

Resource Scan

Scan Details

Site Domain mall.shopee.tw
Base Domain shopee.tw
Scan Status Ok
Last Scan2026-03-03T05:53:42+00:00
Next Scan 2026-03-10T05:53:42+00:00

Last Scan

Scanned2026-03-03T05:53:42+00:00
URL https://mall.shopee.tw/robots.txt
Domain IPs 103.117.4.112
Response IP 103.117.4.112
Found Yes
Hash 3e88d33a190e74d41374900561835cd3bc65b13d19385023ed5f5642797c5da4
SimHash 742c03964585

Groups

googlebot
googlebot-mobile
bingbot

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /buyer/login/otp
Disallow /user/
Disallow /me/
Disallow /order/
Disallow /daily_discover/
Disallow /mall/just-for-you/
Disallow /mall/*-cat.
Disallow /from_same_shop/
Disallow /you_may_also_like/
Disallow *-i.*/similar?from=flash_sale
Disallow /find_similar_products/
Disallow /top_products
Disallow /search*searchPrefill
Disallow /index.html
Disallow /search*hashtag%3D
Disallow /search?shop=
Disallow /buyer/*/rating/
Disallow *-cat.*?category=
Disallow /shop/*/search
Disallow /search/?
Disallow /search?brands=
Disallow /search?originalCategoryId=
Disallow /addon-deal-selection/
Disallow /bundle-deal/
Disallow /search_user
Disallow /search?keyword=*.com
Disallow /blog/?s=
Disallow *utm_source
Disallow /*?*srsltid

Other Records

Field Value
crawl-delay 0.1

*

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /buyer/login/otp
Disallow /user/
Disallow /me/
Disallow /order/
Disallow /daily_discover/
Disallow /mall/just-for-you/
Disallow /mall/*-cat.
Disallow /from_same_shop/
Disallow /you_may_also_like/
Disallow *-i.*/similar
Disallow /find_similar_products/
Disallow /top_products
Disallow /search*searchPrefill
Disallow /index.html
Disallow /blog/?s=

Other Records

Field Value
crawl-delay 1

Warnings

  • 1 invalid line.