wego.co.id
robots.txt
Robots Exclusion Standard data for wego.co.id
Resource Scan
Scan Details
| Site Domain | wego.co.id |
| Base Domain | wego.co.id |
| Scan Status | Ok |
| Last Scan | 2024-09-22T17:56:44+00:00 |
| Next Scan | 2024-09-29T17:56:44+00:00 |
Last Scan
| Scanned | 2024-09-22T17:56:44+00:00 |
| URL | https://wego.co.id/robots.txt |
| Redirect | https://www.wego.co.id/robots.txt |
| Redirect Domain | www.wego.co.id |
| Redirect Base | wego.co.id |
| Domain IPs | 104.18.241.115, 104.18.242.115, 104.18.243.115, 104.18.244.115, 104.18.245.115, 2606:4700::6812:f173, 2606:4700::6812:f273, 2606:4700::6812:f373, 2606:4700::6812:f473, 2606:4700::6812:f573 |
| Redirect IPs | 104.18.241.115, 104.18.242.115, 104.18.243.115, 104.18.244.115, 104.18.245.115, 2606:4700::6812:f173, 2606:4700::6812:f273, 2606:4700::6812:f373, 2606:4700::6812:f473, 2606:4700::6812:f573 |
| Response IP | 104.18.241.115 |
| Found | Yes |
| Hash | ce0ea99bc5cae2346ed4449ee4a94c387a0059c8986d024096732c957bc52ae7 |
| SimHash | 34105d564d20 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*hotels/listing |
| Disallow | /*hotels/search |
| Disallow | /*hotels/drawer |
| Disallow | /*hotels/searched_hotel |
| Disallow | /*hotels/continue/ |
| Disallow | /hotels/search/create |
| Disallow | /hotels/search/results |
| Disallow | /hotels/historical/ajax/js/ |
| Disallow | /hotels/continue/ |
| Disallow | /en/search_create |
| Disallow | /en/search_results |
| Disallow | /en/historical_ajax_js |
| Disallow | /en/continue |
| Disallow | /*api/search |
| Disallow | /api/redirect/flight/book.html |
| Disallow | /flights/progress.html |
| Disallow | /flights/hand_off |
| Disallow | /flights/domestic/hand_off |
| Disallow | /*flights/search |
| Disallow | /*flights/searches |
| Disallow | /*searches |
| Disallow | /*flights/results |
| Disallow | /penerbangan/progress.html |
| Disallow | /penerbangan/hand_off |
| Disallow | /penerbangan/domestic/hand_off |
| Disallow | /*penerbangan/search |
| Disallow | /*penerbangan/searches |
| Disallow | /penerbangan/searches |
| Disallow | /*penerbangan/results |
| Disallow | /id/penerbangan/progress.html |
| Disallow | /id/penerbangan/search |
| Disallow | /id/penerbangan/search.html |
| Disallow | /id/penerbangan/hand_off |
| Disallow | /id/penerbangan/domestic/hand_off |
| Disallow | /en/progress_html |
| Disallow | /en/hand_off |
| Disallow | /en/domestic_hand_off |
| Disallow | /en/all_search |
| Disallow | /en/all_searches |
| Disallow | /en/searches |
| Disallow | /en/results |
| Disallow | /*gigya |
| Disallow | /rentals |
| Disallow | /holiday-rentals |
| Disallow | /holiday-homes |
| Disallow | /holiday-lettings |
| Disallow | /vacation-rentals |
| Disallow | /deals/continue/ |
| Disallow | /*/live$ |
| Disallow | /analytics/ |
| Disallow | /*ulang%3D |
| Disallow | /*app_route%3Dstatic-pages |
| Disallow | /*/wp-includes |
| Disallow | /*/wp-content/plugins |
| Disallow | /*/wp-content/cache |
| Disallow | /*/wp-content/themes |
| Disallow | /activities/product/ |
| Allow | /*activities/product/dubai-expo-2020-tickets-fcf1$ |