aviasales.ru
robots.txt
Robots Exclusion Standard data for aviasales.ru
Resource Scan
Scan Details
| Site Domain | aviasales.ru |
| Base Domain | aviasales.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-11T03:41:08+00:00 |
| Next Scan | 2024-11-18T03:41:08+00:00 |
Last Scan
| Scanned | 2024-11-11T03:41:08+00:00 |
| URL | https://aviasales.ru/robots.txt |
| Domain IPs | 13.35.238.124, 13.35.238.39, 13.35.238.65, 13.35.238.90 |
| Response IP | 13.35.238.90 |
| Found | Yes |
| Hash | 2fb299deb9da58b2e3589f46902e39cbaedca039b9a70eb6d616d15a1626f0a4 |
| SimHash | 69255e50cf51 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /publications |
| Disallow | /mag/archive-email |
| Disallow | /my |
| Disallow | /favorites |
| Disallow | /gopro/* |
| Disallow | /offers/filter* |
| Disallow | /promo/frosty_grandpa/* |
| Disallow | /search |
| Disallow | /hotels |
| Disallow | /click |
| Disallow | /booking |
| Disallow | /psgr/article/doggystyle |
| Disallow | /psgr/article/win-win |
| Disallow | /psgr/article/fucking-omol |
| Disallow | /auid |
| Disallow | /psgr/article/5kg |
| Disallow | /psgr/article/katya-dorogaya-s-dnem-rozhdeniya-pust-shastje-vsegda-stuchitsja-v-tvoyu-dver |
| Disallow | /faq/instructions/* |
| Disallow | /support_survey |
| Disallow | /support/help |
| Disallow | /walks/led/obzornaya/* |
| Disallow | /walks/evn/obzornaya/* |
| Disallow | /walks/bak/obzornaya/* |
| Disallow | /walks/bud/obzornaya/* |
| Disallow | /walks/mow/obzornaya/* |
| Disallow | /walks/ist/obzornaya/* |
| Disallow | /walks/tbs/obzornaya/* |
| Disallow | /walks/kgd/obzornaya/* |
| Disallow | /walks/kzn/obzornaya/* |
| Disallow | /walks/par/obzornaya/* |
| Disallow | /assisted* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aviasales.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.