edreams.com.au
robots.txt

Robots Exclusion Standard data for edreams.com.au

Resource Scan

Scan Details

Site Domain edreams.com.au
Base Domain edreams.com.au
Scan Status Ok
Last Scan2024-06-02T17:40:40+00:00
Next Scan 2024-06-09T17:40:40+00:00

Last Scan

Scanned2024-06-02T17:40:40+00:00
URL https://edreams.com.au/robots.txt
Redirect https://www.edreams.com.au/robots.txt
Redirect Domain www.edreams.com.au
Redirect Base edreams.com.au
Domain IPs 35.246.196.126
Redirect IPs 104.18.40.246, 172.64.147.10
Response IP 104.18.40.246
Found Yes
Hash 2a1c2695e2a3899a12affc69211d6d5ba2f134fa13e0199564ac9a3b3a609373
SimHash 85c017f6e654

Groups

*

Rule Path Comment
Disallow /cgi-bin/ Disallowed for obvious reasons...
Disallow /javascript/ -
Disallow /styles/ -

adsbot-google-mobile

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adnettrack

Rule Path
Disallow /

searchtone2.0

Rule Path
Disallow /

leiacrawler

Rule Path
Disallow /

whatsup_gold/5.01

Rule Path
Disallow /

mindcrawler

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /engine/ItinerarySearch/search
Disallow /engine/ItinerarySearch/resident
Disallow /engine/ItinerarySearch/paging
Disallow /engine/DynPackSearch/search
Disallow /engine/DynPackSearch/paging
Disallow /edreams/shared/amadeus3/checkPreSearch.jhtml
Disallow /engine/AccommodationSearch/search/
Disallow /engine/AccommodationSearch/searchAccommodationRooms
Disallow /engine/ItinerarySearch/disambiguate
Disallow /edreams/espanol/amadeus3/checkPreSearch.jhtml
Disallow /edreams/italiano/amadeus3/checkPreSearch.jhtml
Disallow /images/us/swoosh/swoosh_US.swf
Allow /travel/static-content/
Disallow /cdn-cgi/

Comments

  • PS-414
  • PS-182
  • SEOMKT-1381
  • SEOMKT-3669