aviasales.ro
robots.txt

Robots Exclusion Standard data for aviasales.ro

Resource Scan

Scan Details

Site Domain aviasales.ro
Base Domain aviasales.ro
Scan Status Ok
Last Scan2024-09-22T07:18:37+00:00
Next Scan 2024-09-29T07:18:37+00:00

Last Scan

Scanned2024-09-22T07:18:37+00:00
URL https://aviasales.ro/robots.txt
Domain IPs 13.33.88.119, 13.33.88.42, 13.33.88.6, 13.33.88.73
Response IP 13.33.88.73
Found Yes
Hash f2e7ddebc61baa8009fd83b3c8a9947347cbdfde2889e7a799f0c66461676221
SimHash a451756a1e72

Groups

*

Rule Path
Disallow /routes/
Disallow /airports
Disallow /airports/
Disallow /airlines
Disallow /airlines/
Disallow /cities
Disallow /cities/
Disallow /countries
Disallow /countries/
Disallow /my
Disallow /favorites
Disallow /offers/filter*
Disallow /search
Disallow /hotels
Disallow /click
Disallow /booking
Disallow /auid
Disallow /support_survey

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Comments

  • Hide content seo pages because its do not present on that domain

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.