Log In Sign Up

ws.tokopedia.com
robots.txt

Robots Exclusion Standard data for ws.tokopedia.com

Resource Scan

Scan Details

Site Domain ws.tokopedia.com
Base Domain tokopedia.com
Scan Status Ok
Last Scan2025-03-24T01:20:27+00:00
Next Scan 2025-04-07T01:20:27+00:00

Last Scan

Scanned2025-03-24T01:20:27+00:00
URL https://ws.tokopedia.com/robots.txt
Domain IPs 23.46.230.133, 23.46.230.157
Response IP 23.49.60.64
Found Yes
Hash 93be5f10767965f80795f037d4bec78d355107730464d3107088d4d30c1ce0dc
SimHash b94507f2e693

Groups

*

Rule Path
Disallow /search?*
Disallow /search/*
Disallow /flight/search/*
Disallow /events/search*
Disallow /image-search/
Disallow /kartu-kredit*?id=*
Disallow /*.pl
Disallow /amp/api/*
Disallow /feed?sc=*
Disallow /graphql
Disallow /reputationapp/*
Disallow /insight/*
Disallow */tokopedia-lite-production/
Disallow /similar-products*
Disallow /provi/check*
Disallow /*/*/talk
Disallow /*/*/review
Disallow /content/*
Disallow /archive-*
Disallow /wishlist?*
Disallow /tokopoints
Disallow /rekomendasi/*/d/
Allow /tokopoints/intro/
Disallow /careers/*
Allow /careers/jobs/
Allow /careers/function/internship/
Disallow /people/*
Disallow /p/tour-travel
Back to top

Other Records

Field Value
sitemap https://www.tokopedia.com/sitemap/catalog-index.xml
sitemap https://www.tokopedia.com/sitemap/category-index.xml
sitemap https://www.tokopedia.com/sitemap/products-index-0.xml
sitemap https://www.tokopedia.com/sitemap/products-index-1.xml
sitemap https://www.tokopedia.com/sitemap/products-index-2.xml
sitemap https://www.tokopedia.com/sitemap/products-index-3.xml
sitemap https://www.tokopedia.com/sitemap/products-index-4.xml
sitemap https://www.tokopedia.com/sitemap/products-index-5.xml
sitemap https://www.tokopedia.com/sitemap/products-index-6.xml
sitemap https://www.tokopedia.com/sitemap/products-index-7.xml
sitemap https://www.tokopedia.com/sitemap/products-index-8.xml
sitemap https://www.tokopedia.com/sitemap/products-index-9.xml
sitemap https://www.tokopedia.com/sitemap/product-find-index.xml
sitemap https://www.tokopedia.com/sitemap/recharge-index.xml
sitemap https://www.tokopedia.com/sitemap/shop-index.xml
sitemap https://www.tokopedia.com/sitemap/flight-index.xml
sitemap https://www.tokopedia.com/sitemap/events-index.xml
sitemap https://www.tokopedia.com/sitemap/deals-index.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-0.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-1.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-2.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-3.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-4.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-5.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-6.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-7.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-8.xml
sitemap https://www.tokopedia.com/sitemap/product-find-city-index-9.xml
sitemap https://www.tokopedia.com/sitemap/official-store-category-index.xml
sitemap https://www.tokopedia.com/sitemap/official-store-index.xml
sitemap https://www.tokopedia.com/sitemap/official-store-brand-index.xml
sitemap https://www.tokopedia.com/sitemap/hotel-index.xml
sitemap https://www.tokopedia.com/sitemap/egold-index.xml
Back to top