wego.co.in
robots.txt

Robots Exclusion Standard data for wego.co.in

Resource Scan

Scan Details

Site Domain wego.co.in
Base Domain wego.co.in
Scan Status Ok
Last Scan2024-06-18T06:12:17+00:00
Next Scan 2024-06-25T06:12:17+00:00

Last Scan

Scanned2024-06-18T06:12:17+00:00
URL https://wego.co.in/robots.txt
Redirect https://www.wego.co.in/robots.txt
Redirect Domain www.wego.co.in
Redirect Base wego.co.in
Domain IPs 104.18.241.115, 104.18.242.115, 104.18.243.115, 104.18.244.115, 104.18.245.115, 2606:4700::6812:f173, 2606:4700::6812:f273, 2606:4700::6812:f373, 2606:4700::6812:f473, 2606:4700::6812:f573
Redirect IPs 104.18.241.115, 104.18.242.115, 104.18.243.115, 104.18.244.115, 104.18.245.115, 2606:4700::6812:f173, 2606:4700::6812:f273, 2606:4700::6812:f373, 2606:4700::6812:f473, 2606:4700::6812:f573
Response IP 104.18.241.115
Found Yes
Hash 44c54c1f7f9c46700ae6c3374f3f398cf1897f54744db9f73ba3f5caaa3a0568
SimHash 46103b764b22

Groups

*

Rule Path
Disallow /*hotels/listing
Disallow /*hotels/search
Disallow /*hotels/drawer
Disallow /*hotels/searched_hotel
Disallow /*hotels/continue/
Disallow /hotels/search/create
Disallow /hotels/search/results
Disallow /hotels/historical/ajax/js/
Disallow /hotels/continue/
Disallow /*api/search
Disallow /api/redirect/flight/book.html
Disallow /flights/progress.html
Disallow /flights/hand_off
Disallow /flights/domestic/hand_off
Disallow /*flights/search
Disallow /*flights/searches
Disallow /*searches
Disallow /*flights/results
Disallow /*gigya
Disallow /rentals
Disallow /holiday-rentals
Disallow /holiday-homes
Disallow /holiday-lettings
Disallow /vacation-rentals
Disallow /deals/continue/
Disallow /*/live$
Disallow /analytics/
Disallow /*ulang%3D
Disallow /*app_route%3Dstatic-pages
Disallow /bn
Disallow /gu
Disallow /kn
Disallow /ml
Disallow /mr
Disallow /or
Disallow /ta
Disallow /te
Disallow /bn/flights/search*
Disallow /gu/flights/search*
Disallow /kn/flights/search*
Disallow /ml/flights/search*
Disallow /mr/flights/search*
Disallow /or/flights/search*
Disallow /ta/flights/search*
Disallow /te/flights/search*
Disallow /hi/flights/search*
Disallow /pa/flights/search*
Disallow /*/wp-includes
Disallow /*/wp-content/plugins
Disallow /*/wp-content/cache
Disallow /*/wp-content/themes
Disallow /activities/product/
Allow /*activities/product/dubai-expo-2020-tickets-fcf1$