Log In Sign Up

164.ru
robots.txt

Robots Exclusion Standard data for 164.ru

Resource Scan

Scan Details

Site Domain 164.ru
Base Domain 164.ru
Scan Status Ok
Last Scan2024-05-13T10:54:14+00:00
Next Scan 2024-05-20T10:54:14+00:00

Last Scan

Scanned2024-05-13T10:54:14+00:00
URL https://164.ru/robots.txt
Domain IPs 195.19.220.26
Response IP 195.19.220.26
Found Yes
Hash ce99bedf37ec68806b3b9b34b8aa7bd761a4a9031d162dc6bff9ffd2d1e69a9b
SimHash 1e165030f337

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

zen_bot/2.0

Rule Path
Allow *?utm_source=
Allow *?from=
Allow /text/yandex-news.region.xml

yandexnews

Rule Path
Allow */yanews/
Allow /rss/yandex/
Allow *?from=yanews
Allow *?utm_source=
Allow /text/yandex-news.region.xml

*

Rule Path
Disallow */search
Disallow */comments/
Disallow /passport/
Disallow /market/
Disallow /help/
Disallow /feedback/
Disallow /site_map/
Disallow /map/
Disallow /gm-api/
Disallow /quizzes/
Disallow *page%3D1
Disallow *discuss%3D
Disallow *full%3D
Disallow */?share
Disallow /?
Disallow */?ngs_token=
Disallow */?dateFrom=
Disallow */*%26dateFrom%3D
Disallow */?set_cookie=
Disallow /text/*/?page=
Disallow */?recordId=
Disallow *%26regionId%3D
Disallow *%26shareCard%3D
Disallow *?previewToken=
Disallow *?google_preview=
Disallow *?_ym_debug=
Disallow */yanews/
Disallow *?mindbox-message-key=
Disallow *?from=
Disallow *?utm_
Disallow *?amp
Disallow *?rec=
Disallow *?etext=
Disallow *?startedAtGte=
Disallow *?place=
Disallow *?kids=
Disallow *?*free=
Disallow /afisha/all-events/
Disallow /afisha/cinema-events/
Disallow /afisha/concert-events/
Disallow /afisha/theatre-events/
Disallow /afisha/kids-events/
Disallow /afisha/sport-events/
Disallow /afisha/art-events/
Disallow /afisha/other-events/
Back to top

Other Records

Field Value
sitemap https://164.ru/sitemap.xml
sitemap https://164.ru/exchange/sitemap.xml
Back to top

Comments

  • 1
  • 2
  • 3
  • 5-afisha
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top