wotif.com
robots.txt

Robots Exclusion Standard data for wotif.com

Resource Scan

Scan Details

Site Domain wotif.com
Base Domain wotif.com
Scan Status Ok
Last Scan2024-09-26T17:01:11+00:00
Next Scan 2024-10-03T17:01:11+00:00

Last Scan

Scanned2024-09-26T17:01:11+00:00
URL https://wotif.com/robots.txt
Redirect https://www.wotif.com/robots.txt
Redirect Domain www.wotif.com
Redirect Base wotif.com
Domain IPs 23.200.176.10
Redirect IPs 23.53.216.10
Response IP 23.53.216.10
Found Yes
Hash cb0e3cf6909e6e6836ad788053a6bf4aff116b7ddfb47e41df2692a13747cf05
SimHash 1d5d73e18334

Groups

*

Rule Path
Disallow /Hotel-Search
Disallow /ugc/urs/api/hotelreviews/hotel/HOTELID/
Disallow /LastBooking/ElapsedTime
Disallow /*Hotel-Information?
Disallow /*Hotel-Reviews
Disallow /HotelCheckout
Disallow /Checkout
Disallow /HotelBookingConfirmation
Disallow /Flights-Search
Disallow /Flight-Information
Disallow /Flight-SearchResults
Disallow /Flights-BagFees
Disallow /Details
Disallow /FlightCheckout
Disallow /Confirmation-Flight
Disallow /MultiItemCheckout
Disallow /MultiItemBookingConfirmation
Disallow /flexibleshopping
Disallow /carsearch
Disallow /CarCheckout
Disallow /things-to-do/search
Disallow /*/things-to-do/search
Disallow /Cruise-Search
Disallow /Cruise-CabinCategory
Disallow /CruiseCheckout
Disallow /legacyGOTO
Disallow /go/
Disallow /info/
Disallow /trips/
Disallow /Search-Results
Disallow /user/createaccount
Disallow /things-to-do/reviews-external$
Disallow /api/uisprime/track
Disallow /trvl-px/
Disallow /egcs/v2/collect
Disallow /api/ucs/shortlist/
Disallow /api/v4/typeahead/

google-hoteladsverifier
mediapartners-google
adsbot-google-mobile
adsbot-google

Rule Path
Allow /
Disallow /api/uisprime/track
Disallow /trvl-px/
Disallow /egcs/v2/collect
Disallow /api/ucs/shortlist/
Disallow /api/v4/typeahead/

adidxbot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

Comments

  • General bots
  • hotel
  • flight
  • package
  • car
  • activities
  • cruise
  • other
  • test-seo
  • Google Ads
  • test-seo
  • Bing Ads
  • SemrushBot