anyway.com
robots.txt

Robots Exclusion Standard data for anyway.com

Resource Scan

Scan Details

Site Domain anyway.com
Base Domain anyway.com
Scan Status Ok
Last Scan2025-08-26T01:05:04+00:00
Next Scan 2025-09-25T01:05:04+00:00

Last Scan

Scanned2025-08-26T01:05:04+00:00
URL http://anyway.com/robots.txt
Redirect https://www.expedia.fr/robots.txt
Redirect Domain www.expedia.fr
Redirect Base expedia.fr
Domain IPs 204.74.99.101
Redirect IPs 23.207.180.191
Response IP 23.207.180.191
Found Yes
Hash 82b7c2f876082b8de3948c35ef3d6b344bd8b3b944915862deee9cde43f575ca
SimHash 1c5f73f08334

Groups

*

Rule Path
Disallow /Hotel-Search
Disallow /hotel-search
Disallow /ugc/urs/api/hotelreviews/hotel/HOTELID/
Disallow /LastBooking/ElapsedTime
Disallow /*Description-Hotel?
Disallow /*Hotel-Information?
Disallow /HotelCheckout
Disallow /Checkout
Disallow /checkout
Disallow /HotelBookingConfirmation
Disallow /Flights-Search
Disallow /Flight-Information
Disallow /Flight-SearchResults
Disallow /Flights-BagFees
Disallow /Details
Disallow /FlightCheckout
Disallow /Confirmation-Flight
Disallow /MultiItemCheckout
Disallow /MultiItemBookingConfirmation
Disallow /flexibleshopping
Disallow /carsearch
Disallow /CarCheckout
Disallow /things-to-do/search
Disallow /things-to-do/*/search
Disallow /*/things-to-do/search
Disallow /Cruise-Search
Disallow /Cruise-CabinCategory
Disallow /CruiseCheckout
Disallow /legacyGOTO
Disallow /go/
Disallow /info/
Disallow /trips/
Disallow /Search-Results
Disallow /photos/*%2B*
Disallow /user/createaccount
Disallow /signup?*
Disallow /login?*
Disallow /things-to-do/reviews-external$
Disallow /en/
Disallow /api/uisprime/track
Disallow /trvl-px/
Disallow /egcs/v2/collect
Disallow /api/ucs/shortlist/
Disallow /api/v4/typeahead/

google-hoteladsverifier
mediapartners-google
adsbot-google-mobile
adsbot-google

Rule Path
Allow /
Disallow /api/uisprime/track
Disallow /trvl-px/
Disallow /egcs/v2/collect
Disallow /api/ucs/shortlist/
Disallow /api/v4/typeahead/

adidxbot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

oai-searchbot
chatgpt-user
perplexitybot
perplexity-user
claude-user
claude-searchbot

Rule Path
Allow /

Comments

  • General bots
  • hotel
  • flight
  • package
  • car
  • activities
  • cruise
  • other
  • lang
  • test-seo
  • Google Ads
  • test-seo
  • Bing Ads
  • SemrushBot
  • Allow Agentic Search