ae-en.flightnetwork.com
robots.txt
Robots Exclusion Standard data for ae-en.flightnetwork.com
Resource Scan
Scan Details
| Site Domain | ae-en.flightnetwork.com |
| Base Domain | flightnetwork.com |
| Scan Status | Ok |
| Last Scan | 2024-06-21T08:32:58+00:00 |
| Next Scan | 2024-07-05T08:32:58+00:00 |
Last Scan
| Scanned | 2024-06-21T08:32:58+00:00 |
| URL | https://ae-en.flightnetwork.com/robots.txt |
| Domain IPs | 125.56.219.18, 23.32.29.104, 2600:1413:1::173b:a879 |
| Response IP | 23.52.171.233 |
| Found | Yes |
| Hash | cb9847adf145d170b6ac9ea96d16ec124afb6baa5a7266b9fbf0bca0841f1ad5 |
| SimHash | 784d7600f872 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax* |
| Disallow | /*.action$ |
| Disallow | /rf/mobile-travel-plan/* |
| Disallow | /from/ |
| Disallow | /top/ |
| Disallow | /rf/start |
| Disallow | /rf/result |
| Disallow | /rf/traveler-details |
| Disallow | /rf/payment |
| Disallow | /rf/order-login |
| Disallow | /order-ntd-generate-ref/ |
| Disallow | /payment |
| Disallow | /sourcefiles/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ae-en.flightnetwork.com/sitemap.xml |