Log In Sign Up

booking.kayak.com
robots.txt

Robots Exclusion Standard data for booking.kayak.com

Resource Scan

Scan Details

Site Domain booking.kayak.com
Base Domain kayak.com
Scan Status Ok
Last Scan2024-06-14T22:04:29+00:00
Next Scan 2024-06-28T22:04:29+00:00

Last Scan

Scanned2024-06-14T22:04:29+00:00
URL https://booking.kayak.com/robots.txt
Domain IPs 151.101.1.29, 151.101.129.29, 151.101.193.29, 151.101.65.29, 2a04:4e42:200::285, 2a04:4e42:400::285, 2a04:4e42:600::285, 2a04:4e42::285
Response IP 199.232.45.29
Found Yes
Hash d7ed0cb23cba701ca149ffbbfef839ba3bf7883a51c8a14120b23ba26b08d5e6
SimHash bb829943433e

Groups

*

Rule Path
Disallow /
Back to top

Comments

  • robots.txt for production site.
  • See http://www.robotstxt.org/wc/exclusion-admin.html
  • default robots.txt for when a rewrite is not provided.
  • Usually this is for internal tools
Back to top

Warnings

  • `noindex` is not a known field.
Back to top