edreams.com.au
robots.txt
Robots Exclusion Standard data for edreams.com.au
Resource Scan
Scan Details
Site Domain | edreams.com.au |
Base Domain | edreams.com.au |
Scan Status | Ok |
Last Scan | 2024-06-02T17:40:40+00:00 |
Next Scan | 2024-06-09T17:40:40+00:00 |
Last Scan
Scanned | 2024-06-02T17:40:40+00:00 |
URL | https://edreams.com.au/robots.txt |
Redirect | https://www.edreams.com.au/robots.txt |
Redirect Domain | www.edreams.com.au |
Redirect Base | edreams.com.au |
Domain IPs | 35.246.196.126 |
Redirect IPs | 104.18.40.246, 172.64.147.10 |
Response IP | 104.18.40.246 |
Found | Yes |
Hash | 2a1c2695e2a3899a12affc69211d6d5ba2f134fa13e0199564ac9a3b3a609373 |
SimHash | 85c017f6e654 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin/ | Disallowed for obvious reasons... |
Disallow | /javascript/ | - |
Disallow | /styles/ | - |
*
Rule | Path |
---|---|
Disallow | /engine/ItinerarySearch/search |
Disallow | /engine/ItinerarySearch/resident |
Disallow | /engine/ItinerarySearch/paging |
Disallow | /engine/DynPackSearch/search |
Disallow | /engine/DynPackSearch/paging |
Disallow | /edreams/shared/amadeus3/checkPreSearch.jhtml |
Disallow | /engine/AccommodationSearch/search/ |
Disallow | /engine/AccommodationSearch/searchAccommodationRooms |
Disallow | /engine/ItinerarySearch/disambiguate |
Disallow | /edreams/espanol/amadeus3/checkPreSearch.jhtml |
Disallow | /edreams/italiano/amadeus3/checkPreSearch.jhtml |
Disallow | /images/us/swoosh/swoosh_US.swf |
Allow | /travel/static-content/ |
Disallow | /cdn-cgi/ |
Comments