cheapoair.co.uk
robots.txt
Robots Exclusion Standard data for cheapoair.co.uk
Resource Scan
Scan Details
| Site Domain | cheapoair.co.uk |
| Base Domain | cheapoair.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-14T22:20:16+00:00 |
| Next Scan | 2024-12-13T22:20:16+00:00 |
Last Successful Scan
| Scanned | 2023-10-28T22:15:40+00:00 |
| URL | https://cheapoair.co.uk/robots.txt |
| Redirect | https://www.cheapoair.co.uk/robots.txt |
| Redirect Domain | www.cheapoair.co.uk |
| Redirect Base | cheapoair.co.uk |
| Domain IPs | 23.59.168.105 |
| Redirect IPs | 23.52.171.224, 23.52.171.56 |
| Response IP | 23.52.171.224 |
| Found | Yes |
| Hash | 970179a1c9a91bdf044b1423ec77f0d11e2e5bc8aea4434cc537a35ab6a7c1a5 |
| SimHash | 0d65f0614666 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /default.aspx |
| Disallow | /*.swf$ |
| Allow | /assets |
| Disallow | /personalization |
| Disallow | /fpnext/ |
| Disallow | /es-us/fpnext/ |
| Disallow | /remotesearch |
| Disallow | /es-us/remotesearch |
| Disallow | /airsearchapi/ |
| Disallow | /airpaymentapi/ |
| Disallow | /affiliatetrackingapi/ |
| Disallow | /fpnap |
| Disallow | /mfhotel |
| Disallow | /fpnexthotel |
| Disallow | /crosssell |
| Disallow | /carnext |
| Disallow | /vacationpackages |
| Disallow | /profiles/ |
| Disallow | /confirmation |
| Disallow | /it-it/confirmation |
| Disallow | /cn/mn/confirmation |
| Disallow | /jp-jp/confirmation |
| Disallow | /ph-ph/confirmation |
| Disallow | /kr-kr/confirmation |
| Disallow | /tr-tr/confirmation |
| Disallow | /en-ae/confirmation |
| Disallow | /en-in/confirmation |
| Disallow | /en-sg/confirmation |
| Disallow | /en-hk/confirmation |
| Disallow | /en-za/confirmation |
| Disallow | /en-cn/confirmation |
| Disallow | /en-gy/confirmation |
| Disallow | /en-ie/confirmation |
| Disallow | /en-my/confirmation |
| Disallow | /en-nz/confirmation |
| Disallow | /en-ph/confirmation |
| Disallow | /en-tr/confirmation |
| Disallow | /es-ar/confirmation |
| Disallow | /es-bo/confirmation |
| Disallow | /es-br/confirmation |
| Disallow | /es-cl/confirmation |
| Disallow | /es-co/confirmation |
| Disallow | /es-do/confirmation |
| Disallow | /es-ec/confirmation |
| Disallow | /es-es/confirmation |
| Disallow | /es-pe/confirmation |
| Disallow | /es-sr/confirmation |
| Disallow | /es-us/confirmation |
| Disallow | /es-uy/confirmation |
| Disallow | /es-ve/confirmation |
| Allow | /travel/ |
| Allow | /JS/ |
| Allow | /Desktopmodules/ |
| Allow | /DesktopModules/ |
| Allow | /desktopmodules/ |
| Allow | /portals/ |
| Allow | /Travel/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cheapoair.co.uk/sitemap.xml |
| sitemap | https://www.cheapoair.co.uk/xmlsslsitemaphandler.ashx |
| sitemap | https://www.cheapoair.co.uk/miles-away/sitemap.xml |
Comments