Log In Sign Up

airbnb.co.il
robots.txt

Robots Exclusion Standard data for airbnb.co.il

Resource Scan

Scan Details

Site Domain airbnb.co.il
Base Domain airbnb.co.il
Scan Status Ok
Last Scan2024-06-06T03:00:22+00:00
Next Scan 2024-06-20T03:00:22+00:00

Last Scan

Scanned2024-06-06T03:00:22+00:00
URL https://airbnb.co.il/robots.txt
Redirect https://www.airbnb.co.il/robots.txt
Redirect Domain www.airbnb.co.il
Redirect Base airbnb.co.il
Domain IPs 52.70.55.180, 54.147.35.199, 54.221.90.222
Redirect IPs 184.50.85.131, 184.50.85.137, 184.50.85.138, 184.50.85.154, 96.17.180.18, 96.17.180.2, 96.17.180.24, 96.17.180.25, 96.17.180.32
Response IP 23.59.168.170
Found Yes
Hash eeec101146022964ece8956899c9ae0d5ec5f2ca737e5b71f2099ab6235953d7
SimHash 4c3789108dd4

Groups

googlebot

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks

bingbot

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks

yandexbot

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks

baiduspider

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks

*

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks
Back to top

Other Records

Field Value
sitemap https://www.airbnb.co.il/sitemap-master-index.xml.gz
Back to top

Comments

  • ///////
  • // //
  • // //
  • // // /// /// ///
  • // // /// ///
  • // /// // //// /// /// /// //// /// //// /// //// /// ////
  • // /// /// // ////////// /// ////////// /////////// ////////// ///////////
  • // // // // /// /// /// /// /// /// /// /// /// ///
  • // // // // /// /// /// /// /// /// /// /// /// ///
  • // // // // /// /// /// /// /// /// /// /// /// ///
  • // // // // ////////// /// /// ////////// /// /// //////////
  • // ///// //
  • // ///// //
  • // /// /// //
  • ////// //////
  • Hello bot, engineer, or very lost layperson! Welcome to your stay on the Airbnb site, we're happy to have you as a guest.
  • If you're a human who likes solving interesting challenges with other humans, check out our careers page: https://www.airbnb.com/careers/departments/engineering
  • If you're a bot who likes crawling webpages, please mind the house rules and avoid accessing any disallowed subfolders to earn a 5-star review from us.
  • Either way, thanks for stopping by! There's no need to collect your garbage at the end of your stay - we use Javascript for that.
  • See you on the next crawl!
Back to top