airbnb.is
robots.txt
Robots Exclusion Standard data for airbnb.is
Resource Scan
Scan Details
Site Domain | airbnb.is |
Base Domain | airbnb.is |
Scan Status | Ok |
Last Scan | 2024-09-22T14:31:59+00:00 |
Next Scan | 2024-10-06T14:31:59+00:00 |
Last Scan
Scanned | 2024-09-22T14:31:59+00:00 |
URL | https://airbnb.is/robots.txt |
Redirect | https://www.airbnb.is/robots.txt |
Redirect Domain | www.airbnb.is |
Redirect Base | airbnb.is |
Domain IPs | 34.231.2.231, 44.223.197.210, 54.243.237.216 |
Redirect IPs | 23.32.29.104, 23.32.29.90 |
Response IP | 23.52.40.58 |
Found | Yes |
Hash | 984a6ce1c192ef8f23ae3a72f669edb5520ecd198f2a96ee10604e1a69aded29 |
SimHash | 4c3789188dd4 |
Groups
googlebot
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
bingbot
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
yandexbot
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
baiduspider
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
*
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
Other Records
Field | Value |
---|---|
sitemap | https://www.airbnb.is/sitemap-master-index.xml.gz |
Comments