tokopedia.com
robots.txt
Robots Exclusion Standard data for tokopedia.com
Resource Scan
Scan Details
| Site Domain | tokopedia.com |
| Base Domain | tokopedia.com |
| Scan Status | Ok |
| Last Scan | 2024-09-02T01:58:13+00:00 |
| Next Scan | 2024-10-02T01:58:13+00:00 |
Last Scan
| Scanned | 2024-09-02T01:58:13+00:00 |
| URL | https://tokopedia.com/robots.txt |
| Redirect | https://www.tokopedia.com/robots.txt |
| Redirect Domain | www.tokopedia.com |
| Redirect Base | tokopedia.com |
| Domain IPs | 47.74.234.244 |
| Redirect IPs | 23.211.140.120, 23.211.140.155 |
| Response IP | 23.49.60.160 |
| Found | Yes |
| Hash | 024d07a6ab89e375d3f78ca32ca2cbac433edcfba84186fd8a4edc2aa1e79084 |
| SimHash | fa465cfae333 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /.well-known/ |
| Allow | /*/review |
| Allow | /*/*/review |
| Allow | /blog/etalase |
| Allow | /blog/note |
| Allow | /blog/review |
| Allow | /find/*?page |
| Allow | /tokopoints/intro/ |
| Disallow | */aggregate |
| Disallow | */tokopedia-lite-production/ |
| Disallow | /*.pl |
| Disallow | /*?whid=* |
| Disallow | /*categoryfilter* |
| Disallow | /*src%3Dsearch* |
| Disallow | /*/*/talk |
| Disallow | /*/note |
| Disallow | /action |
| Disallow | /admin-confirmation |
| Disallow | /amp/api/* |
| Disallow | /archive-* |
| Disallow | /bebas-ongkir |
| Disallow | /beli-langsung |
| Disallow | /blog/*/%7B%7Bad_click_url%7D%7D |
| Disallow | /blog/*/?s= |
| Disallow | /blog/tag/* |
| Disallow | /blog/?s=* |
| Disallow | /cart?* |
| Disallow | /cart/* |
| Disallow | /catalog/*%7B |
| Disallow | /chat?* |
| Disallow | /chat/* |
| Disallow | /chatbot |
| Disallow | /content/* |
| Disallow | /e-pharmacy |
| Disallow | /events/search* |
| Disallow | /favorite-shop |
| Disallow | /feed?sc=* |
| Disallow | /feedcommunicationdetail/* |
| Disallow | /find/*?%7B* |
| Disallow | /find/*?goldmerchant=true |
| Disallow | /find/*?official=true |
| Disallow | /find/*?shipping=* |
| Disallow | /find/*/c/* |
| Disallow | /flight/search/* |
| Disallow | /gopay |
| Disallow | /gopay/* |
| Disallow | /graphql |
| Disallow | /hotel/*/?id |
| Disallow | /hotel/*/?source=SEOPAGEINTERNALLINKS |
| Disallow | /hotel/*/?type |
| Disallow | /hotel/*/*check_in%3D* |
| Disallow | /hotel/search* |
| Disallow | /image-search/ |
| Disallow | /inbox-reputation |
| Disallow | /inbox-reputation/* |
| Disallow | /inbox-talk |
| Disallow | /inbox-talk/* |
| Disallow | /inbox-user |
| Disallow | /info/logistic/* |
| Disallow | /insight/* |
| Disallow | /kartu-kredit*?id=* |
| Disallow | /membership/* |
| Disallow | /myorder/* |
| Disallow | /myshop/* |
| Disallow | /notif-center |
| Disallow | /onboard |
| Disallow | /order-details/* |
| Disallow | /order-list |
| Disallow | /order-list/* |
| Disallow | /otp-failed-push-notif |
| Disallow | /p/tour-travel |
| Disallow | /payment/* |
| Disallow | /payment-confirm |
| Disallow | /payment-confirm/* |
| Disallow | /people/* |
| Disallow | /provi/check* |
| Disallow | /recent-view |
| Disallow | /redeem |
| Disallow | /rekomendasi/*/d/ |
| Disallow | /reputationapp/* |
| Disallow | /resolution-center/* |
| Disallow | /resolution-center-new/* |
| Disallow | /rewards/*/status-matching |
| Disallow | /rewards/*/membership |
| Disallow | /rewards/bebas-ongkir |
| Disallow | /search?* |
| Disallow | /search/* |
| Disallow | /seller-placeholder |
| Disallow | /shop-interrupt |
| Disallow | /shipping-label |
| Disallow | /similar-products* |
| Disallow | /skema-keanggotaan-baru |
| Disallow | /skema-keanggotaan-baru/* |
| Disallow | /tokopoints |
| Disallow | /tokopedia-corner |
| Disallow | /updatedob |
| Disallow | /wishlist?* |
| Disallow | /helios-client/* |
| Disallow | /session_trace/* |
| Disallow | /spa/* |
| Disallow | /*/*/ajax/* |
| Disallow | /*/*/metrics/* |
| Disallow | /*/*/spa/* |
| Disallow | /*/*/page_view_event/* |
| Disallow | /*/*/page_view_timing/* |
| Disallow | /*/*/jserrors/* |
| Disallow | /*/*/*/ajax/* |
| Disallow | /*/*/*/metrics/* |
| Disallow | /*/*/*/spa/* |
| Disallow | /*/*/*/page_view_event/* |
| Disallow | /*/*/*/page_view_timing/* |
| Disallow | /*/*/*/jserrors/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tokopedia.com/sitemap/catalog-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/category-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/deals-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/egold-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/events-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/flight-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/hotel-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/official-store-brand-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/official-store-category-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/official-store-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/play-channel.xml |
| sitemap | https://www.tokopedia.com/sitemap/product-find-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-0.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-1.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-2.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-3.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-4.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-5.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-6.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-7.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-8.xml |
| sitemap | https://www.tokopedia.com/sitemap/products-index-9.xml |
| sitemap | https://www.tokopedia.com/sitemap/recharge-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/review-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/salam-index.xml |
| sitemap | https://www.tokopedia.com/sitemap/shop-score-index.xml |