cheapoair.mx
robots.txt
Robots Exclusion Standard data for cheapoair.mx
Resource Scan
Scan Details
Site Domain | cheapoair.mx |
Base Domain | cheapoair.mx |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-24T16:04:42+00:00 |
Next Scan | 2024-12-23T16:04:42+00:00 |
Last Successful Scan
Scanned | 2023-11-07T15:12:56+00:00 |
URL | https://cheapoair.mx/robots.txt |
Redirect | https://www.cheapoair.mx/robots.txt |
Redirect Domain | www.cheapoair.mx |
Redirect Base | cheapoair.mx |
Domain IPs | 23.52.40.25, 23.52.40.35 |
Redirect IPs | 23.32.29.88, 23.32.29.90 |
Response IP | 23.52.171.234 |
Found | Yes |
Hash | 0d0facc8339bc2e3eddb95dbd95eb89449ba143898a99b04aa5efe34f2cc5117 |
SimHash | 0567a0614666 |
Groups
*
Rule | Path |
---|---|
Disallow | /default.aspx |
Disallow | /*.swf$ |
Allow | /assets |
Disallow | /personalization |
Disallow | /fpnext/ |
Disallow | /es-us/fpnext/ |
Disallow | /remotesearch |
Disallow | /es-us/remotesearch |
Disallow | /airsearchapi/ |
Disallow | /airpaymentapi/ |
Disallow | /affiliatetrackingapi/ |
Disallow | /fpnap |
Disallow | /mfhotel |
Disallow | /fpnexthotel |
Disallow | /crosssell |
Disallow | /carnext |
Disallow | /vacationpackages |
Disallow | /profiles/ |
Disallow | /confirmation |
Disallow | /it-it/confirmation |
Disallow | /cn/mn/confirmation |
Disallow | /jp-jp/confirmation |
Disallow | /ph-ph/confirmation |
Disallow | /kr-kr/confirmation |
Disallow | /tr-tr/confirmation |
Disallow | /en-ae/confirmation |
Disallow | /en-in/confirmation |
Disallow | /en-sg/confirmation |
Disallow | /en-hk/confirmation |
Disallow | /en-za/confirmation |
Disallow | /en-cn/confirmation |
Disallow | /en-gy/confirmation |
Disallow | /en-ie/confirmation |
Disallow | /en-my/confirmation |
Disallow | /en-nz/confirmation |
Disallow | /en-ph/confirmation |
Disallow | /en-tr/confirmation |
Disallow | /es-ar/confirmation |
Disallow | /es-bo/confirmation |
Disallow | /es-br/confirmation |
Disallow | /es-cl/confirmation |
Disallow | /es-co/confirmation |
Disallow | /es-do/confirmation |
Disallow | /es-ec/confirmation |
Disallow | /es-es/confirmation |
Disallow | /es-pe/confirmation |
Disallow | /es-sr/confirmation |
Disallow | /es-us/confirmation |
Disallow | /es-uy/confirmation |
Disallow | /es-ve/confirmation |
Allow | /travel/ |
Allow | /JS/ |
Allow | /Desktopmodules/ |
Allow | /DesktopModules/ |
Allow | /desktopmodules/ |
Allow | /portals/ |
Allow | /Travel/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.cheapoair.mx/sitemap.xml |
sitemap | https://www.cheapoair.mx/xmlsslsitemaphandler.ashx |
sitemap | https://www.cheapoair.mx/miles-away/sitemap.xml |
Comments