klook.com
robots.txt
Robots Exclusion Standard data for klook.com
Resource Scan
Scan Details
Site Domain | klook.com |
Base Domain | klook.com |
Scan Status | Ok |
Last Scan | 2024-11-05T02:21:20+00:00 |
Next Scan | 2024-11-19T02:21:20+00:00 |
Last Scan
Scanned | 2024-11-05T02:21:20+00:00 |
URL | https://klook.com/robots.txt |
Redirect | https://www.klook.com:443/robots.txt |
Redirect Domain | www.klook.com |
Redirect Base | klook.com |
Domain IPs | 34.149.181.71 |
Redirect IPs | 13.227.254.17, 13.227.254.41, 13.227.254.42, 13.227.254.44 |
Response IP | 108.156.133.43 |
Found | Yes |
Hash | 7334c0e290beb5b7fbbba26269464951e2d1c926a3a474a0d515243211ef921e |
SimHash | a8504917691b |
Groups
yeti
Rule | Path |
---|---|
Allow | /ko/ |
Disallow | */search* |
Disallow | /zh-TW/ |
Disallow | /zh-CN/ |
Disallow | /zh-HK/ |
Disallow | /th/ |
Disallow | /vi/ |
Disallow | /id/ |
Disallow | /ja/ |
Disallow | /ms-MY/ |
Disallow | /fr/ |
Disallow | /de/ |
Disallow | /it/ |
Disallow | /ru/ |
Disallow | /es/ |
Disallow | /en-GB/ |
Disallow | /en-AU/ |
Disallow | /en-SG/ |
Disallow | /en-CA/ |
Disallow | /en-HK/ |
Disallow | /en-IN/ |
Disallow | /en-MY/ |
Disallow | /en-NZ/ |
Disallow | /en-PH/ |
Disallow | /en-US/ |
Disallow | /event/ |
Disallow | /invite/ |
Disallow | /preview/ |
Disallow | /my_klook/ |
Disallow | /voucher/ |
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
sogou web spider
sogou inst spider
sogou spider
sogou wap spider
Rule | Path |
---|---|
Disallow | /zh-CN/ |
*
Rule | Path |
---|---|
Disallow | /v1/hotelapiserv/hotelapi/review/list |
Disallow | /xos_api/v1/hotelapiserv/hotelapi/review/list |
Disallow | /v1/hotelapiserv/hotelapi/review/recommend |
Disallow | /xos_api/v1/hotelapiserv/hotelapi/review/recommend |
Disallow | /v2/hotelapiserv/hotelapi/destination* |
Disallow | /v3/hotelapiserv/hotelapi/voucherList* |
Disallow | /v3/hotelapiserv/hotelapi/addOn* |
Disallow | /v1/hotelapiserv/hotelapi/hotelImgs* |
Disallow | /v1/hotelapiserv/hotelapi/hotelNearByInfo* |
Disallow | */search/* |
Disallow | */searchresult/* |
Allow | */event/search/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.klook.com/de/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-AU/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-CA/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-GB/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-HK/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-IN/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-MY/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-NZ/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-PH/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-SG/sitemap-master-index.xml |
sitemap | https://www.klook.com/en-US/sitemap-master-index.xml |
sitemap | https://www.klook.com/es/sitemap-master-index.xml |
sitemap | https://www.klook.com/fr/sitemap-master-index.xml |
sitemap | https://www.klook.com/id/sitemap-master-index.xml |
sitemap | https://www.klook.com/it/sitemap-master-index.xml |
sitemap | https://www.klook.com/ja/sitemap-master-index.xml |
sitemap | https://www.klook.com/ko/sitemap-master-index.xml |
sitemap | https://www.klook.com/ru/sitemap-master-index.xml |
sitemap | https://www.klook.com/th/sitemap-master-index.xml |
sitemap | https://www.klook.com/vi/sitemap-master-index.xml |
sitemap | https://www.klook.com/zh-CN/sitemap-master-index.xml |
sitemap | https://www.klook.com/zh-HK/sitemap-master-index.xml |
sitemap | https://www.klook.com/zh-TW/sitemap-master-index.xml |
sitemap | https://www.klook.com/sitemap-master-index.xml |
Warnings
- 3 invalid lines.
Comments