vn.ru
robots.txt

Robots Exclusion Standard data for vn.ru

Resource Scan

Scan Details

Site Domain vn.ru
Base Domain vn.ru
Scan Status Ok
Last Scan2024-06-23T10:08:38+00:00
Next Scan 2024-06-30T10:08:38+00:00

Last Scan

Scanned2024-06-23T10:08:38+00:00
URL https://vn.ru/robots.txt
Domain IPs 78.40.218.109
Response IP 78.40.218.109
Found Yes
Hash f6d4a72b9a83198b50852a2d98cebc2a9fda4e70cfe825832beae6280a48b9be
SimHash 29f09dc3c8f9

Groups

*

Rule Path
Allow /upload/
Allow /news/
Allow /news/rss/
Allow /syuzhety/
Allow /sproject/
Disallow /desktop_app/login/
Disallow /search/
Disallow /*PAGE_NAME%3D
Disallow /*/slide_show/
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*action%3D
Disallow /*print_course%3DY
Disallow /*backurl%3D*
Disallow /*back_url%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$
Disallow /*FULL_VERSION_ONLY
Disallow */?utm_source=*
Disallow /searchy*
Disallow /*?nw=*
Disallow /*?cat_id=*
Disallow /*?ver=*
Disallow /*?q=*
Disallow /*?id*
Disallow /*bxajaxid%3D*
Disallow /*?mregion=*
Disallow /*?flDate=*
Disallow /*rk.php?
Disallow /*rk.php?goto=
Disallow /news/iz/
Disallow /pbn-widjet/

yandex

Rule Path
Allow /upload/
Allow /news/
Allow /syuzhety/
Allow /sproject/
Allow /news/rss/
Disallow /search/*
Disallow /*PAGE_NAME%3D
Disallow /*/slide_show/
Disallow /*%26print%3D
Disallow /*register%3Dyes
Disallow /*forgot_password%3Dyes
Disallow /*change_password%3Dyes
Disallow /*login%3Dyes
Disallow /*logout%3Dyes
Disallow /*auth%3Dyes
Disallow /*action%3D
Disallow /*print_course%3DY
Disallow /*backurl%3D*
Disallow /*back_url%3D*
Disallow /*back_url_admin%3D*
Disallow /*index.php$
Disallow /*FULL_VERSION_ONLY
Disallow */?utm_source=*
Disallow /*.js
Disallow /*.doc*
Disallow /*.pdf
Disallow /*.xls*
Disallow /ua.php
Disallow /searchy*
Disallow /*?nw=*
Disallow /*?cat_id=*
Disallow /*?ver=*
Disallow /*?q=*
Disallow /*?id*
Disallow /*?mregion=*
Disallow /*bxajaxid%3D*
Disallow /*subscr_edit.php*
Disallow /*PAGEN_*
Disallow /*?CODE*
Disallow /*?bitrix_*
Disallow /bitrix*
Disallow /Xindex.html*
Disallow /_tpl*
Disallow /yal_test*
Allow /*.css
Disallow /desktop_app/login/
Disallow /*rk.php?
Disallow /*rk.php?goto=
Disallow /news/iz/
Disallow /pbn-widjet/

yandexnews

Rule Path
Allow /news/json_yandex/
Allow /news/rss/

Other Records

Field Value
crawl-delay 0.1

googlebot

Rule Path
Allow /*.js
Allow /*.css

ahrefsbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

ntentbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

twitterbot

Rule Path
Allow /upload/

Other Records

Field Value
sitemap https://vn.ru/sitemap.xml
sitemap https://vn.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.