justfly.com
robots.txt
Robots Exclusion Standard data for justfly.com
Resource Scan
Scan Details
| Site Domain | justfly.com |
| Base Domain | justfly.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T02:01:15+00:00 |
| Next Scan | 2024-11-17T02:01:15+00:00 |
Last Scan
| Scanned | 2024-11-10T02:01:15+00:00 |
| URL | https://justfly.com/robots.txt |
| Redirect | https://www.justfly.com/robots.txt |
| Redirect Domain | www.justfly.com |
| Redirect Base | justfly.com |
| Domain IPs | 209.126.35.27 |
| Redirect IPs | 104.18.12.48, 104.18.13.48, 2606:4700::6812:c30, 2606:4700::6812:d30 |
| Response IP | 104.18.13.48 |
| Found | Yes |
| Hash | 0a9d19c9b991ca472c0adb7a90936c728c4699d703a9a02c9b9a5ef051dab8e8 |
| SimHash | 0154b46957a1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /flights/ |
| Allow | /flights? |
| Allow | /flights$ |
| Disallow | /privacy-policy |
| Disallow | /privacypolicy |
| Disallow | /fr/privacy-policy |
| Disallow | /fr/privacypolicy |
| Disallow | /terms-and-conditions |
| Disallow | /fr/terms-and-conditions |
| Disallow | /travel-guides |
| Disallow | /fr/travel-guides |
| Disallow | /fares |
| Disallow | /fr/fares |
| Disallow | /account |
| Disallow | /fr/account |
| Disallow | /my-account |
| Disallow | /fr/my-account |
| Disallow | /checkout |
| Disallow | /fr/checkout |
| Disallow | /booking |
| Disallow | /fr/booking |
| Disallow | /support |
| Disallow | /fr/support |
| Disallow | /hotel |
| Disallow | /fr/hotel |
| Disallow | /flight |
| Disallow | /fr/flight |
| Disallow | /cars |
| Disallow | /fr/cars |
| Disallow | /hotels |
| Disallow | /fr/hotels |
| Disallow | /service/booking |
| Disallow | /fr/service/booking |
| Disallow | /service/exchange |
| Disallow | /fr/service/exchange |
| Disallow | /service/schedule-change |
| Disallow | /fr/service/schedule-change |
| Disallow | /service/insurance |
| Disallow | /fr/service/insurance |
| Disallow | /service/portal |
| Disallow | /fr/service/portal |
| Disallow | /landing-flights/ajax |
| Disallow | /fr/landing-flights/ajax |
| Disallow | /cheap-flights*-1 |
| Disallow | /cheap-flights*-2 |
| Disallow | /cheap-flights*-3 |
| Disallow | /cheap-flights*-4 |
| Disallow | /cheap-flights*-5 |
| Disallow | /cheap-flights*-6 |
| Disallow | /cheap-flights*-7 |
| Disallow | /cheap-flights*-8 |
| Disallow | /cheap-flights*-9 |
google-hoteladsverifier
adsbot-google-mobile-apps
adsbot-google-mobile
adsbot-google
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /? |
| Allow | /cheap-flights |
| Allow | /flights/ |
| Allow | /flights? |
| Allow | /flights$ |
| Allow | /email-deals |
| Disallow | /privacy-policy |
| Disallow | /privacypolicy |
| Disallow | /fr/privacy-policy |
| Disallow | /fr/privacypolicy |
| Disallow | /terms-and-conditions |
| Disallow | /fr/terms-and-conditions |
| Disallow | /travel-guides |
| Disallow | /fr/travel-guides |
| Disallow | /fares |
| Disallow | /fr/fares |
| Disallow | /account |
| Disallow | /fr/account |
| Disallow | /my-account |
| Disallow | /fr/my-account |
| Disallow | /checkout |
| Disallow | /fr/checkout |
| Disallow | /booking |
| Disallow | /fr/booking |
| Disallow | /support |
| Disallow | /fr/support |
| Disallow | /hotel |
| Disallow | /fr/hotel |
| Disallow | /flight |
| Disallow | /fr/flight |
| Disallow | /cars |
| Disallow | /fr/cars |
| Disallow | /hotels |
| Disallow | /fr/hotels |
| Disallow | /service/booking |
| Disallow | /fr/service/booking |
| Disallow | /service/exchange |
| Disallow | /fr/service/exchange |
| Disallow | /service/schedule-change |
| Disallow | /fr/service/schedule-change |
| Disallow | /service/insurance |
| Disallow | /fr/service/insurance |
| Disallow | /service/portal |
| Disallow | /fr/service/portal |
| Disallow | /landing-flights/ajax |
| Disallow | /fr/landing-flights/ajax |
Comments