kayak.ai
robots.txt
Robots Exclusion Standard data for kayak.ai
Resource Scan
Scan Details
| Site Domain | kayak.ai |
| Base Domain | kayak.ai |
| Scan Status | Ok |
| Last Scan | 2025-11-12T16:54:22+00:00 |
| Next Scan | 2025-11-19T16:54:22+00:00 |
Last Scan
| Scanned | 2025-11-12T16:54:22+00:00 |
| URL | https://kayak.ai/robots.txt |
| Domain IPs | 151.101.1.29, 151.101.129.29, 151.101.193.29, 151.101.65.29, 2a04:4e42:200::285, 2a04:4e42:400::285, 2a04:4e42:600::285, 2a04:4e42::285 |
| Response IP | 151.101.193.29 |
| Found | Yes |
| Hash | 7225a393df8f1a8168b57c66efdc65deaec168d890438f5bc27b3875cbee7214 |
| SimHash | 68127721c5f3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /privacy |
| Allow | /terms-of-use |
| Disallow | /s/ |
| Disallow | /i/ |
| Disallow | /in |
| Disallow | /help/tripsfaqs |
| Disallow | /help/tripscalendar |
| Disallow | /bookings |
| Disallow | /careers |
| Disallow | /share/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://kayak.ai/sitemap.xml |