us-en.flightnetwork.com
robots.txt
Robots Exclusion Standard data for us-en.flightnetwork.com
Resource Scan
Scan Details
Site Domain | us-en.flightnetwork.com |
Base Domain | flightnetwork.com |
Scan Status | Ok |
Last Scan | 2024-05-30T16:41:46+00:00 |
Next Scan | 2024-06-13T16:41:46+00:00 |
Last Scan
Scanned | 2024-05-30T16:41:46+00:00 |
URL | https://us-en.flightnetwork.com/robots.txt |
Domain IPs | 23.32.29.17, 2600:1413:1::1720:1d63, 2600:1413:1::7d38:db12, 96.17.180.51 |
Response IP | 96.17.180.51 |
Found | Yes |
Hash | a7b050cdd66be8838ef2fe14a47f2cc2a5e8d0789634d1bc85e0511cbffc30e5 |
SimHash | 684d7600fc72 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax* |
Disallow | /*.action$ |
Disallow | /rf/mobile-travel-plan/* |
Disallow | /from/ |
Disallow | /top/ |
Disallow | /rf/start |
Disallow | /rf/result |
Disallow | /rf/traveler-details |
Disallow | /rf/payment |
Disallow | /rf/order-login |
Disallow | /order-ntd-generate-ref/ |
Disallow | /payment |
Disallow | /sourcefiles/ |
Other Records
Field | Value |
---|---|
sitemap | https://us-en.flightnetwork.com/sitemap.xml |