travelata.ru
robots.txt

Robots Exclusion Standard data for travelata.ru

Resource Scan

Scan Details

Site Domain travelata.ru
Base Domain travelata.ru
Scan Status Ok
Last Scan2024-09-19T14:39:41+00:00
Next Scan 2024-09-26T14:39:41+00:00

Last Scan

Scanned2024-09-19T14:39:41+00:00
URL https://travelata.ru/robots.txt
Domain IPs 178.248.232.202
Response IP 178.248.232.202
Found Yes
Hash 8fa7a0e89929ad1e42878a7cb271f7e9879cab15e5c6f9f4fb15ff7bf2d33270
SimHash 25101af3632c

Groups

yandex

Rule Path
Disallow /skin/
Disallow /landing_*
Disallow /tourindex
Disallow /spain-tours
Disallow /greece-tours
Disallow /turkey-tours
Disallow /privacy.html
Disallow /vacancy.html
Disallow /offers.html
Disallow /partners.html
Disallow /terms.html
Disallow /*/tury
Disallow /*/*/tury
Disallow /*/oteli
Disallow /*/*/oteli
Disallow /hottours/hot-tours
Disallow /?cpamit_uid
Disallow /hotel/*utm_
Disallow /other/*utm_
Disallow *ref%3D
Disallow *site%3D
Disallow *attempt%3D
Disallow *yclid%3D
Disallow /other/
Disallow /order/
Disallow /?ru
Disallow /?com
Disallow *ab%3D
Disallow /?edium=email
Disallow /?mtp_id
Disallow /goto/hotel/*
Disallow /*tourPage
Disallow *skipCache%3D
Disallow /*switchToMobile
Disallow *escaped_fragment
Disallow *departureCity
Disallow *block%3D
Disallow *cpamit_uid%3D
Disallow *pos%3D
Disallow *ages%3D
Disallow *children%3D
Disallow *dateFlexible%3D
Disallow *mixcl%3D
Disallow *hot%3D
Disallow *sa%3D
Allow /*/hotels$
Allow /*/hotels*.html$
Disallow /*dlya-otelej-dublej*.html
Disallow /*zakrytye-oteli*.html
Disallow /*oteli-na-rekonstrukcii*.html
Disallow /*otklyuceny-iz-za-plohih-otzyvov*.html
Disallow /api/hotel
Disallow /vip/*
Disallow /intercom
Disallow /*/railwaysTourPage*
Disallow /*railways/search*
Disallow *?*

Other Records

Field Value
crawl-delay 2

googlebot

Rule Path
Disallow /skin/
Disallow /landing_*
Disallow /tourindex
Disallow /spain-tours
Disallow /greece-tours
Disallow /turkey-tours
Disallow /privacy.html
Disallow /offers.html
Disallow /partners.html
Disallow /terms.html
Disallow /*/tury
Disallow /*/*/tury
Disallow /*/oteli
Disallow /*/*/oteli
Disallow /hottours/hot-tours
Disallow /?cpamit_uid
Disallow /hotel/*utm_
Disallow /other/*utm_
Disallow *ref%3D
Disallow *site%3D
Disallow *attempt%3D
Disallow *yclid%3D
Disallow /order/
Disallow /?ru
Disallow /?com
Disallow *ab%3D
Disallow /?edium=email
Disallow /index.php
Disallow /goto/hotel/*
Disallow /*tourPage
Disallow *skipCache%3D
Disallow /*switchToMobile
Disallow *departureCity
Disallow *block%3D
Disallow *cpamit_uid%3D
Disallow *pos%3D
Disallow *ages%3D
Disallow *children%3D
Disallow *dateFlexible%3D
Disallow *mixcl%3D
Disallow *hot%3D
Disallow *sa%3D
Allow /*/hotels$
Allow /*/hotels*.html
Disallow /*dlya-otelej-dublej*.html
Disallow /*zakrytye-oteli*.html
Disallow /*oteli-na-rekonstrukcii*.html
Disallow /*otklyuceny-iz-za-plohih-otzyvov*.html
Disallow /api/hotel
Disallow /vip/*
Disallow /intercom
Disallow /*/railwaysTourPage*
Allow *.js

*

Rule Path
Disallow /skin/
Disallow /landing_*
Disallow /tourindex
Disallow /spain-tours
Disallow /greece-tours
Disallow /turkey-tours
Disallow /privacy.html
Disallow /vacancy.html
Disallow /offers.html
Disallow /partners.html
Disallow /terms.html
Disallow /*/tury
Disallow /*/*/tury
Disallow /*/oteli
Disallow /*/*/oteli
Disallow /hottours/hot-tours
Disallow /?cpamit_uid
Disallow /hotel/*utm_
Disallow /other/*utm_
Disallow *ref%3D
Disallow *site%3D
Disallow *attempt%3D
Disallow *yclid%3D
Disallow /order/
Disallow /?ru
Disallow /?com
Disallow *ab%3D
Disallow /?edium=email
Disallow /goto/hotel/*
Disallow /*tourPage
Disallow *skipCache%3D
Disallow /*switchToMobile
Disallow *escaped_fragment
Disallow *departureCity
Disallow *block%3D
Disallow *cpamit_uid%3D
Disallow *pos%3D
Disallow *ages%3D
Disallow *children%3D
Disallow *dateFlexible%3D
Disallow *mixcl%3D
Disallow *hot%3D
Disallow *sa%3D
Allow /*/hotels$
Allow /*/hotels*.html
Disallow /*dlya-otelej-dublej*.html
Disallow /*zakrytye-oteli*.html
Disallow /*oteli-na-rekonstrukcii*.html
Disallow /*otklyuceny-iz-za-plohih-otzyvov*.html
Disallow /api/hotel
Disallow /vip/*
Disallow /intercom
Disallow /*/railwaysTourPage*

yandexmobilebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

googledocs

Rule Path
Disallow /

pingdom.com_bot_version_1.4

Rule Path
Disallow /

Other Records

Field Value
sitemap https://travelata.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.