lookbyfare.com
robots.txt
Robots Exclusion Standard data for lookbyfare.com
Resource Scan
Scan Details
| Site Domain | lookbyfare.com |
| Base Domain | lookbyfare.com |
| Scan Status | Ok |
| Last Scan | 2026-02-04T16:24:15+00:00 |
| Next Scan | 2026-03-06T16:24:15+00:00 |
Last Scan
| Scanned | 2026-02-04T16:24:15+00:00 |
| URL | https://lookbyfare.com/robots.txt |
| Redirect | https://www.lookbyfare.com/robots.txt |
| Redirect Domain | www.lookbyfare.com |
| Redirect Base | lookbyfare.com |
| Domain IPs | 104.18.2.163, 104.18.3.163, 2606:4700::6812:2a3, 2606:4700::6812:3a3 |
| Redirect IPs | 104.18.2.163, 104.18.3.163, 2606:4700::6812:2a3, 2606:4700::6812:3a3 |
| Response IP | 104.18.3.163 |
| Found | Yes |
| Hash | d0d88751335ad7764f1086c1ee82a9a6f95efc25b6500ad0a9917c1d5e892468 |
| SimHash | c1d3cb5aa469 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?utm* |
| Disallow | /*%26utm* |
| Disallow | /*utm* |
| Disallow | /search/ |
| Disallow | /purchase/ |
| Disallow | /dealsearching/ |
| Disallow | /booked/ |
| Disallow | /us/search/ |
| Disallow | /us/purchase/ |
| Disallow | /us/dealsearching/ |
| Disallow | /us/booked/ |
| Disallow | /us/*?utm* |
| Disallow | /us/*%26utm* |
| Disallow | /us/*utm* |
| Disallow | /us/profile/ |
| Disallow | /hotelSearch/ |
| Disallow | /hotelDirectSearch/ |
| Disallow | /hotels-details/ |
| Disallow | /hotels-payment/ |
| Disallow | /us/flight-search/ |
| Disallow | /flight-search/ |
| Disallow | /us/flight-search-crm/ |
| Disallow | /flight-search-crm/ |
| Disallow | /cdn-cgi/ |
| Disallow | /us/home/getcoutrylist |
| Disallow | /us/paymentauth/init |
| Disallow | /us/car/carsearch/id/ |