wego.com.my
robots.txt
Robots Exclusion Standard data for wego.com.my
Resource Scan
Scan Details
Site Domain | wego.com.my |
Base Domain | wego.com.my |
Scan Status | Ok |
Last Scan | 2024-10-04T21:24:21+00:00 |
Next Scan | 2024-10-11T21:24:21+00:00 |
Last Scan
Scanned | 2024-10-04T21:24:21+00:00 |
URL | https://wego.com.my/robots.txt |
Redirect | https://www.wego.com.my/robots.txt |
Redirect Domain | www.wego.com.my |
Redirect Base | wego.com.my |
Domain IPs | 104.18.241.115, 104.18.242.115, 104.18.243.115, 104.18.244.115, 104.18.245.115, 2606:4700::6812:f173, 2606:4700::6812:f273, 2606:4700::6812:f373, 2606:4700::6812:f473, 2606:4700::6812:f573 |
Redirect IPs | 104.18.241.115, 104.18.242.115, 104.18.243.115, 104.18.244.115, 104.18.245.115, 2606:4700::6812:f173, 2606:4700::6812:f273, 2606:4700::6812:f373, 2606:4700::6812:f473, 2606:4700::6812:f573 |
Response IP | 104.18.245.115 |
Found | Yes |
Hash | 3604ba1ac0e7ab77acf2584d2549bdd31d9e4539aadd2661d9b3f8ec82345f2d |
SimHash | 6410127247a0 |
Groups
*
Rule | Path |
---|---|
Disallow | /*hotels/listing |
Disallow | /*hotels/search |
Disallow | /*hotels/drawer |
Disallow | /*hotels/searched_hotel |
Disallow | /*hotels/continue/ |
Disallow | /hotels/search/create |
Disallow | /hotels/search/results |
Disallow | /hotels/historical/ajax/js/ |
Disallow | /hotels/continue/ |
Disallow | /*api/search |
Disallow | /api/redirect/flight/book.html |
Disallow | /flights/progress.html |
Disallow | /flights/hand_off |
Disallow | /flights/domestic/hand_off |
Disallow | /*flights/search |
Disallow | /*flights/searches |
Disallow | /*searches |
Disallow | /*flights/results |
Disallow | /ms/penerbangan/search* |
Disallow | /zh-cn/flights/search* |
Disallow | /*gigya |
Disallow | /rentals |
Disallow | /holiday-rentals |
Disallow | /holiday-homes |
Disallow | /holiday-lettings |
Disallow | /vacation-rentals |
Disallow | /deals/continue/ |
Disallow | /*/live$ |
Disallow | /analytics/ |
Disallow | /*ulang%3D |
Disallow | /*app_route%3Dstatic-pages |
Disallow | /activities/product/ |
Allow | /*activities/product/dubai-expo-2020-tickets-fcf1$ |