Log In Sign Up

airbnb.co.in
robots.txt

Robots Exclusion Standard data for airbnb.co.in

Resource Scan

Scan Details

Site Domain airbnb.co.in
Base Domain airbnb.co.in
Scan Status Ok
Last Scan2024-05-20T15:01:58+00:00
Next Scan 2024-06-03T15:01:58+00:00

Last Scan

Scanned2024-05-20T15:01:58+00:00
URL https://airbnb.co.in/robots.txt
Redirect https://www.airbnb.co.in/robots.txt
Redirect Domain www.airbnb.co.in
Redirect Base airbnb.co.in
Domain IPs 52.6.191.200, 54.158.98.59, 54.208.128.64
Redirect IPs 23.52.171.203, 23.52.171.224, 23.52.171.58, 23.59.168.162
Response IP 23.52.40.32
Found Yes
Hash e24aafab0cc0a8e252323da790c217451a563ddae383efc7abeaad44397bbd2e
SimHash 4c3689108dd4

Groups

googlebot

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks

bingbot

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks

yandexbot

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks

baiduspider

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks

*

Rule Path
Allow /calendar/ical/
Allow /.well-known/amphtml/apikey.pub
Disallow /account
Disallow /alumni
Disallow /associates/click
Disallow /api/v1/trebuchet
Disallow /calendar/
Disallow /disaster/lookup
Disallow /email/unsubscribe
Disallow /fix-it
Disallow /fixit
Disallow /forgot_password
Disallow /groups
Disallow /help/search
Disallow /help/feedback
Disallow /home/dashboard
Disallow /inbox
Disallow /logout
Disallow /manage-listing
Disallow /messaging/ajax_already_messaged/
Disallow /my_listings
Disallow /skeleton$
Disallow /skeleton/
Disallow /payments/book
Disallow /signup_modal
Disallow /signed_out_modal.json
Disallow /.well-known/assetlinks.json
Disallow /help/search
Disallow /trips/upcoming
Disallow /trips/v1/
Disallow /update-your-browser
Disallow /reservation
Disallow /rooms/*/safety
Disallow /rooms/*/reviews
Disallow /rooms/*/photos
Disallow /rooms/*/location
Disallow /rooms/*/house-rules
Disallow /rooms/*/enhanced-cleaning
Disallow /rooms/*/amenities
Disallow /users/show
Disallow /users/*/listings
Disallow /contact_host
Disallow /book
Disallow /stories
Disallow /embeddable
Disallow /guidebooks
Back to top

Other Records

Field Value
sitemap https://www.airbnb.co.in/sitemap-master-index.xml.gz
Back to top

Comments

  • ///////
  • // //
  • // //
  • // // /// /// ///
  • // // /// ///
  • // /// // //// /// /// /// //// /// //// /// //// /// ////
  • // /// /// // ////////// /// ////////// /////////// ////////// ///////////
  • // // // // /// /// /// /// /// /// /// /// /// ///
  • // // // // /// /// /// /// /// /// /// /// /// ///
  • // // // // /// /// /// /// /// /// /// /// /// ///
  • // // // // ////////// /// /// ////////// /// /// //////////
  • // ///// //
  • // ///// //
  • // /// /// //
  • ////// //////
  • Hello bot, engineer, or very lost layperson! Welcome to your stay on the Airbnb site, we're happy to have you as a guest.
  • If you're a human who likes solving interesting challenges with other humans, check out our careers page: https://www.airbnb.com/careers/departments/engineering
  • If you're a bot who likes crawling webpages, please mind the house rules and avoid accessing any disallowed subfolders to earn a 5-star review from us.
  • Either way, thanks for stopping by! There's no need to collect your garbage at the end of your stay - we use Javascript for that.
  • See you on the next crawl!
Back to top