airbnb.az
robots.txt
Robots Exclusion Standard data for airbnb.az
Resource Scan
Scan Details
Site Domain | airbnb.az |
Base Domain | airbnb.az |
Scan Status | Ok |
Last Scan | 2024-06-28T22:05:36+00:00 |
Next Scan | 2024-07-12T22:05:36+00:00 |
Last Scan
Scanned | 2024-06-28T22:05:36+00:00 |
URL | https://airbnb.az/robots.txt |
Redirect | https://www.airbnb.az/robots.txt |
Redirect Domain | www.airbnb.az |
Redirect Base | airbnb.az |
Domain IPs | 52.45.0.112, 52.72.79.113, 54.156.154.5 |
Redirect IPs | 23.52.40.25, 23.52.40.32 |
Response IP | 23.59.168.146 |
Found | Yes |
Hash | 6a45eed71feb05c0145b99f115e36a0012968d4b32704c7411f1576559c46dd5 |
SimHash | 4c3789108dd4 |
Groups
googlebot
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
bingbot
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
yandexbot
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
baiduspider
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
*
Rule | Path |
---|---|
Allow | /calendar/ical/ |
Allow | /.well-known/amphtml/apikey.pub |
Disallow | /account |
Disallow | /alumni |
Disallow | /associates/click |
Disallow | /api/v1/trebuchet |
Disallow | /calendar/ |
Disallow | /disaster/lookup |
Disallow | /email/unsubscribe |
Disallow | /fix-it |
Disallow | /fixit |
Disallow | /forgot_password |
Disallow | /groups |
Disallow | /help/search |
Disallow | /help/feedback |
Disallow | /home/dashboard |
Disallow | /inbox |
Disallow | /logout |
Disallow | /manage-listing |
Disallow | /messaging/ajax_already_messaged/ |
Disallow | /my_listings |
Disallow | /skeleton$ |
Disallow | /skeleton/ |
Disallow | /payments/book |
Disallow | /signup_modal |
Disallow | /signed_out_modal.json |
Disallow | /.well-known/assetlinks.json |
Disallow | /help/search |
Disallow | /trips/upcoming |
Disallow | /trips/v1/ |
Disallow | /update-your-browser |
Disallow | /reservation |
Disallow | /rooms/*/safety |
Disallow | /rooms/*/reviews |
Disallow | /rooms/*/photos |
Disallow | /rooms/*/location |
Disallow | /rooms/*/house-rules |
Disallow | /rooms/*/enhanced-cleaning |
Disallow | /rooms/*/amenities |
Disallow | /users/show |
Disallow | /users/*/listings |
Disallow | /contact_host |
Disallow | /book |
Disallow | /stories |
Disallow | /embeddable |
Disallow | /guidebooks |
Other Records
Field | Value |
---|---|
sitemap | https://www.airbnb.az/sitemap-master-index.xml.gz |
Comments