booking.jetstar.com
robots.txt

Robots Exclusion Standard data for booking.jetstar.com

Resource Scan

Scan Details

Site Domain booking.jetstar.com
Base Domain jetstar.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-03-22T13:30:26+00:00
Next Scan 2024-06-20T13:30:26+00:00

Last Successful Scan

Scanned2023-10-31T18:44:42+00:00
URL https://booking.jetstar.com/robots.txt
Domain IPs 23.32.29.89, 23.32.29.91
Response IP 23.32.29.91
Found Yes
Hash 4600994bbdd6b687eda2a4560bcb20de66fd1ebe6c432c21db235e93ff7d6485
SimHash a834993acab6

Groups

*

Rule Path
Disallow /

Comments

  • Remember to allow few of the indexable regions production