aviasales.pt
robots.txt

Robots Exclusion Standard data for aviasales.pt

Resource Scan

Scan Details

Site Domain aviasales.pt
Base Domain aviasales.pt
Scan Status Ok
Last Scan2024-09-18T22:59:29+00:00
Next Scan 2024-09-25T22:59:29+00:00

Last Scan

Scanned2024-09-18T22:59:29+00:00
URL https://aviasales.pt/robots.txt
Domain IPs 13.33.88.107, 13.33.88.29, 13.33.88.3, 13.33.88.40
Response IP 13.33.88.3
Found Yes
Hash 8883f8ce84f69b5b546a3d1a62311dbfa1728f767bea2328e2811957d6bdbc6a
SimHash a450376a1e73

Groups

*

Rule Path
Disallow /routes/
Disallow /airports
Disallow /airports/
Disallow /airlines
Disallow /airlines/
Disallow /cities
Disallow /cities/
Disallow /countries
Disallow /countries/
Disallow /my
Disallow /favorites
Disallow /offers/filter*
Disallow /search
Disallow /hotels
Disallow /click
Disallow /booking
Disallow /auid
Disallow /support_survey

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Comments

  • Hide content seo pages because its do not present on that domain

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.