liligo.com.au
robots.txt

Robots Exclusion Standard data for liligo.com.au

Resource Scan

Scan Details

Site Domain liligo.com.au
Base Domain liligo.com.au
Scan Status Ok
Last Scan2024-11-09T12:15:36+00:00
Next Scan 2024-11-16T12:15:36+00:00

Last Scan

Scanned2024-11-09T12:15:36+00:00
URL https://liligo.com.au/robots.txt
Redirect https://www.liligo.com.au/robots.txt
Redirect Domain www.liligo.com.au
Redirect Base liligo.com.au
Domain IPs 104.18.38.74, 172.64.149.182, 2606:4700:4400::6812:264a, 2606:4700:4400::ac40:95b6
Redirect IPs 104.18.38.74, 172.64.149.182, 2606:4700:4400::6812:264a, 2606:4700:4400::ac40:95b6
Response IP 172.64.149.182
Found Yes
Hash be65565ffbf5625d00d85d2c71b2538815a9c9b2acc194197987c5f13a405ee8
SimHash 96e0edde2792

Groups

*

Rule Path
Disallow /flight/results
Disallow /air/SearchFlights.jsp
Disallow /air/HeaderFlightsJSON.jsp
Disallow /air/LabelsJSON.jsp
Disallow /air/RedirectFlight.jsp
Disallow /air/RedirectFlightOneWay.jsp
Disallow /air/relaunchSearch.jsp
Disallow /air/ResultsFlights.jsp
Disallow /air/searchFriend.jsp
Disallow /air/sendSearch.jsp
Disallow /air/buzzResults.jsp
Disallow /air/landingAlert.jsp
Disallow /hotel/HeaderHotelsJSON.jsp
Disallow /hotel/LabelsJSON.jsp
Disallow /hotel/recommend_liligo.jsp
Disallow /hotel/RedirectHotel.jsp
Disallow /hotel/RedirectReviewHotel.jsp
Disallow /hotel/relaunchSearch.jsp
Disallow /hotel/ResultsHotels.jsp
Disallow /hotel/HeaderHotelsJSON.jsp
Disallow /hotel/review.jsp
Disallow /hotel/searchFriend.jsp
Disallow /hotel/searchHotels.jsp
Disallow /hotel_v3/
Disallow /hotellanding.jsp
Disallow /homepage/siteunder.jsp
Disallow /homepage/hotel-byname.jsp
Disallow /v5/homepage
Disallow /iphone/support
Disallow /static/iphoneapp.jsp
Disallow /static/iphonesupport.jsp
Disallow /iphone/info.jsp
Disallow /gateway/
Disallow /wpartner/
Disallow /mobileweb_v4/api/
Disallow /v3/
Disallow /cars/sc.jsp
Disallow /icafe/
Disallow /android/
Disallow /myliligo/
Allow /a/api/comparesite/src/
Disallow /a/
Allow /my-liligo/flight-alert-create
Disallow /my-liligo/flight-alert
Disallow /gateway/blogs/
Disallow /error/404
Disallow /error/429
Allow /*/img/
Allow /img/

Other Records

Field Value
sitemap https://www.liligo.com.au/sitemap.xml

Comments

  • Robots file for www.liligo.com.au
  • Apply rules to all user agents
  • air restrictions
  • hotel restrictions
  • homepages restrictions
  • static restrictions
  • gateway restrictions
  • other restrictions
  • Error pages
  • Images
  • Sitemap