mall.shopee.ph
robots.txt

Robots Exclusion Standard data for mall.shopee.ph

Resource Scan

Scan Details

Site Domain mall.shopee.ph
Base Domain shopee.ph
Scan Status Ok
Last Scan2026-02-20T18:58:49+00:00
Next Scan 2026-02-27T18:58:49+00:00

Last Scan

Scanned2026-02-20T18:58:49+00:00
URL https://mall.shopee.ph/robots.txt
Domain IPs 147.136.172.150
Response IP 147.136.172.150
Found Yes
Hash 88c288606bff4e6f664fe50f1f60fbf80a9b402e5607c8f22e61c53c9d029442
SimHash 2c3512565c4c

Groups

googlebot
googlebot-mobile
bingbot

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /buyer/login/otp
Disallow /user/
Disallow /me/
Disallow /order/
Disallow /daily_discover/
Disallow /mall/just-for-you/
Disallow /mall/*-cat.
Disallow /from_same_shop/
Disallow /you_may_also_like/
Disallow *-i.*/similar?from=flash_sale
Disallow /find_similar_products/
Disallow /top_products
Disallow /search*searchPrefill
Disallow /index.html
Disallow /search*hashtag%3D
Disallow /search?shop=
Disallow /buyer/*/rating/
Disallow *-cat.*?category=
Disallow /shop/*/search
Disallow /shop/*/details
Disallow /search/?
Disallow /search?brands=
Disallow /search?originalCategoryId=
Disallow /addon-deal-selection/
Disallow /bundle-deal/
Disallow *?sp_atk=
Disallow /search_user
Disallow /search?keyword=*.com
Disallow /blog/?s=
Disallow *utm_source
Disallow /search*.com
Disallow /api/v4/shop/rcmd_items
Disallow /api/v4/recommend/*
Disallow /api/v4/homepage/get_daily_discover

Other Records

Field Value
crawl-delay 0.1

*

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /buyer/login/otp
Disallow /user/
Disallow /me/
Disallow /order/
Disallow /daily_discover/
Disallow /mall/just-for-you/
Disallow /mall/*-cat.
Disallow /from_same_shop/
Disallow /you_may_also_like/
Disallow *-i.*/similar
Disallow /find_similar_products/
Disallow /top_products
Disallow /search*searchPrefill
Disallow /index.html

Other Records

Field Value
crawl-delay 1

Warnings

  • 10 invalid lines.