flighthub.com
robots.txt
Robots Exclusion Standard data for flighthub.com
Resource Scan
Scan Details
| Site Domain | flighthub.com |
| Base Domain | flighthub.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-03-13T01:16:02+00:00 |
| Next Scan | 2024-06-11T01:16:02+00:00 |
Last Successful Scan
| Scanned | 2022-11-12T17:28:07+00:00 |
| URL | https://flighthub.com/robots.txt |
| Redirect | https://www.flighthub.com/robots.txt |
| Redirect Domain | www.flighthub.com |
| Redirect Base | flighthub.com |
| Response IP | 104.18.20.98, 104.18.21.98 |
| Found | Yes |
| Hash | cd8c86abf7b8252b6d9ddd1404439f2c8c7e282da931d1b2d9477e785a33f14e |
| SimHash | 0154b46947a9 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /flights/ |
| Allow | /flights? |
| Allow | /flights$ |
| Disallow | /privacy-policy |
| Disallow | /privacypolicy |
| Disallow | /fr/privacy-policy |
| Disallow | /fr/privacypolicy |
| Disallow | /terms-and-conditions |
| Disallow | /fr/terms-and-conditions |
| Disallow | /travel-guides |
| Disallow | /fr/travel-guides |
| Disallow | /fares |
| Disallow | /fr/fares |
| Disallow | /account |
| Disallow | /fr/account |
| Disallow | /my-account |
| Disallow | /fr/my-account |
| Disallow | /checkout |
| Disallow | /fr/checkout |
| Disallow | /booking |
| Disallow | /fr/booking |
| Disallow | /support |
| Disallow | /fr/support |
| Disallow | /hotel |
| Disallow | /fr/hotel |
| Disallow | /flight |
| Disallow | /fr/flight |
| Disallow | /cars |
| Disallow | /fr/cars |
| Disallow | /hotels |
| Disallow | /fr/hotels |
| Disallow | /service/booking |
| Disallow | /fr/service/booking |
| Disallow | /service/exchange |
| Disallow | /fr/service/exchange |
| Disallow | /service/schedule-change |
| Disallow | /fr/service/schedule-change |
| Disallow | /service/insurance |
| Disallow | /fr/service/insurance |
| Disallow | /service/portal |
| Disallow | /fr/service/portal |
| Disallow | /landing-flights/ajax |
| Disallow | /fr/landing-flights/ajax |
| Disallow | /cheap-flights*-1 |
| Disallow | /cheap-flights*-2 |
| Disallow | /cheap-flights*-3 |
| Disallow | /cheap-flights*-4 |
| Disallow | /cheap-flights*-5 |
| Disallow | /cheap-flights*-6 |
| Disallow | /cheap-flights*-7 |
| Disallow | /cheap-flights*-8 |
| Disallow | /cheap-flights*-9 |
google-hoteladsverifier
adsbot-google-mobile-apps
adsbot-google-mobile
adsbot-google
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /? |
| Allow | /cheap-flights |
| Allow | /flights/ |
| Allow | /flights? |
| Allow | /flights$ |
| Disallow | /privacy-policy |
| Disallow | /privacypolicy |
| Disallow | /fr/privacy-policy |
| Disallow | /fr/privacypolicy |
| Disallow | /terms-and-conditions |
| Disallow | /fr/terms-and-conditions |
| Disallow | /travel-guides |
| Disallow | /fr/travel-guides |
| Disallow | /fares |
| Disallow | /fr/fares |
| Disallow | /account |
| Disallow | /fr/account |
| Disallow | /my-account |
| Disallow | /fr/my-account |
| Disallow | /checkout |
| Disallow | /fr/checkout |
| Disallow | /booking |
| Disallow | /fr/booking |
| Disallow | /support |
| Disallow | /fr/support |
| Disallow | /hotel |
| Disallow | /fr/hotel |
| Disallow | /flight |
| Disallow | /fr/flight |
| Disallow | /cars |
| Disallow | /fr/cars |
| Disallow | /hotels |
| Disallow | /fr/hotels |
| Disallow | /service/booking |
| Disallow | /fr/service/booking |
| Disallow | /service/exchange |
| Disallow | /fr/service/exchange |
| Disallow | /service/schedule-change |
| Disallow | /fr/service/schedule-change |
| Disallow | /service/insurance |
| Disallow | /fr/service/insurance |
| Disallow | /service/portal |
| Disallow | /fr/service/portal |
| Disallow | /landing-flights/ajax |
| Disallow | /fr/landing-flights/ajax |
Comments