aviasales.ru
robots.txt
Robots Exclusion Standard data for aviasales.ru
Resource Scan
Scan Details
| Site Domain | aviasales.ru |
| Base Domain | aviasales.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-24T13:15:28+00:00 |
| Next Scan | 2024-05-31T13:15:28+00:00 |
Last Scan
| Scanned | 2024-05-24T13:15:28+00:00 |
| URL | https://aviasales.ru/robots.txt |
| Redirect | https://www.aviasales.ru/robots.txt |
| Redirect Domain | www.aviasales.ru |
| Redirect Base | aviasales.ru |
| Domain IPs | 3.163.43.121, 3.163.43.20, 3.163.43.75, 3.163.43.96 |
| Redirect IPs | 108.158.213.112, 108.158.213.26, 108.158.213.58, 108.158.213.63 |
| Response IP | 52.84.229.25 |
| Found | Yes |
| Hash | bfa9f08aedb72536803993a66aaf87d27a5807ba3c6b829accab2ac0dc77b28d |
| SimHash | 69250e408bd3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /publications |
| Disallow | /mag/archive-email |
| Disallow | /my |
| Disallow | /gopro/* |
| Disallow | /offers/filter* |
| Disallow | /promo/frosty_grandpa/* |
| Disallow | /search |
| Disallow | /hotels |
| Disallow | /click |
| Disallow | /booking |
| Disallow | /psgr/article/doggystyle |
| Disallow | /psgr/article/win-win |
| Disallow | /psgr/article/fucking-omol |
| Disallow | /auid |
| Disallow | /psgr/article/5kg |
| Disallow | /psgr/article/katya-dorogaya-s-dnem-rozhdeniya-pust-shastje-vsegda-stuchitsja-v-tvoyu-dver |
| Disallow | /faq/instructions/* |
| Disallow | /support_survey |
| Disallow | /walks/led/obzornaya/* |
| Disallow | /walks/evn/obzornaya/* |
| Disallow | /walks/bak/obzornaya/* |
| Disallow | /walks/bud/obzornaya/* |
| Disallow | /walks/mow/obzornaya/* |
| Disallow | /walks/ist/obzornaya/* |
| Disallow | /walks/tbs/obzornaya/* |
| Disallow | /walks/kgd/obzornaya/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aviasales.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.