zen.yandex.com
robots.txt

Robots Exclusion Standard data for zen.yandex.com

Resource Scan

Scan Details

Site Domain zen.yandex.com
Base Domain yandex.com
Scan Status Ok
Last Scan2024-09-21T12:08:21+00:00
Next Scan 2024-09-28T12:08:21+00:00

Last Scan

Scanned2024-09-21T12:08:21+00:00
URL https://zen.yandex.com/robots.txt
Redirect https://dzen.ru/robots.txt
Redirect Domain dzen.ru
Redirect Base dzen.ru
Domain IPs 2a02:6b8::4fa, 87.250.254.116
Redirect IPs 62.217.160.2
Response IP 62.217.160.2
Found Yes
Hash c809a75259bf0f5c043ea9670d2955458c4190d3c18d3b4165e747b954c351b9
SimHash 64038275d730

Groups

yandex

Rule Path
Allow /
Allow /.well-known/assetlinks.json
Allow /*?utm_sourse=55
Disallow /about*?*
Disallow /away
Disallow /top$
Disallow /search
Disallow /money
Disallow /onboarding
Disallow /news/top
Disallow /news/smi
Disallow /news/search
Disallow /t/
Disallow /user/
Disallow /embed/
Disallow /*/url
Disallow /video/games/tags/
Disallow /*sso_failed%3D
Disallow /*erid%3D
Disallow /*.html$
Disallow /*?utm*

googlebot

Rule Path
Allow /
Allow /.well-known/assetlinks.json
Disallow /about*?*
Disallow /away
Disallow /top$
Disallow /search
Disallow /money
Disallow /onboarding
Disallow /news/top
Disallow /news/smi
Disallow /news/search
Disallow /t/
Disallow /user/
Disallow /embed/
Disallow /*/url
Disallow /video/games/tags/
Disallow /*_csrf
Disallow /*action
Disallow /*amp
Disallow /*ampplace
Disallow /*amupr_id
Disallow /*appsearch_header%3D
Disallow /*autoplay%3D
Disallow /*backoffice%3D
Disallow /*branding%3D
Disallow /*briefEditorPublicationId%3D
Disallow /*bx_sender_conversion_id%3D
Disallow /*cachebust%3D
Disallow /*clid%3D
Disallow /*collection%3D
Disallow /*country_code%3D
Disallow /*erid%3D
Disallow /*experiment%3D
Disallow /*feed_exp%3D
Disallow /*from_cloud%3D
Disallow /*from_page%3D
Disallow /*invite%3D
Disallow /*loop%3D
Disallow /*pulse_user_id%3D
Disallow /*sso_failed%3D
Disallow /*t%3D
Disallow /*to%3D
Disallow /*token%3D
Disallow /*utm_referrer%3D
Disallow /*utm_source%3D

mail.ru

Rule Path
Allow /
Allow /.well-known/assetlinks.json
Disallow /about*?*
Disallow /top$
Disallow /search
Disallow /money
Disallow /onboarding
Disallow /news/top
Disallow /news/smi
Disallow /news/search
Disallow /t/
Disallow /user/
Disallow /embed/
Disallow /*/url
Disallow /video/games/tags/
Disallow /*sso_failed%3D
Disallow /*to%3D
Disallow /*erid%3D
Disallow /*.html$

bingbot

Rule Path
Allow /
Allow /.well-known/assetlinks.json
Disallow /about*?*
Disallow /top$
Disallow /search
Disallow /money
Disallow /onboarding
Disallow /news/top
Disallow /news/smi
Disallow /news/search
Disallow /t/
Disallow /user/
Disallow /embed/
Disallow /*/url
Disallow /video/games/tags/
Disallow /*sso_failed%3D
Disallow /*to%3D
Disallow /*erid%3D
Disallow /*.html$

applebot

Rule Path
Allow /
Allow /.well-known/assetlinks.json
Disallow /about*?*
Disallow /away
Disallow /top$
Disallow /search
Disallow /money
Disallow /onboarding
Disallow /news/top
Disallow /news/smi
Disallow /news/search
Disallow /t/
Disallow /user/
Disallow /embed/
Disallow /*/url
Disallow /video/games/tags/
Disallow /*?sso_failed=
Disallow /*to%3D
Disallow /*erid%3D
Disallow /*.html$

baiduspider

Rule Path
Allow /
Allow /.well-known/assetlinks.json
Disallow /about*?*
Disallow /away
Disallow /top$
Disallow /search
Disallow /money
Disallow /onboarding
Disallow /news/top
Disallow /news/smi
Disallow /news/search
Disallow /t/
Disallow /user/
Disallow /embed/
Disallow /*/url
Disallow /video/games/tags/
Disallow /*?sso_failed=
Disallow /*to%3D
Disallow /*erid%3D
Disallow /*.html$

msnbot

Rule Path
Allow /
Allow /.well-known/assetlinks.json
Disallow /about*?*
Disallow /away
Disallow /top$
Disallow /search
Disallow /money
Disallow /onboarding
Disallow /news/top
Disallow /news/smi
Disallow /news/search
Disallow /t/
Disallow /user/
Disallow /embed/
Disallow /*/url
Disallow /video/games/tags/
Disallow /*sso_failed%3D
Disallow /*to%3D
Disallow /*erid%3D
Disallow /*.html$

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /
Allow /.well-known/assetlinks.json
Disallow /about*?*
Disallow /away
Disallow /top$
Disallow /search
Disallow /money
Disallow /onboarding
Disallow /news/top
Disallow /news/smi
Disallow /news/search
Disallow /t/
Disallow /user/
Disallow /*/url
Disallow /video/games/tags/
Disallow /*sso_failed%3D
Disallow /*to%3D
Disallow /*erid%3D
Disallow /*.html$

Other Records

Field Value
sitemap https://dzen.ru/sitemaps/brief_v2/sitemap.xml
sitemap https://dzen.ru/sitemaps/brief_v2/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/channels_v2/sitemap.xml
sitemap https://dzen.ru/sitemaps/channels_v2/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/gif_long_v2/sitemap.xml
sitemap https://dzen.ru/sitemaps/gif_long_v2/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/gif_short_v2/sitemap.xml
sitemap https://dzen.ru/sitemaps/gif_short_v2/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/image_v2/sitemap.xml
sitemap https://dzen.ru/sitemaps/image_v2/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/native_v2/sitemap.xml
sitemap https://dzen.ru/sitemaps/native_v2/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/slug-factory/sitemap.xml
sitemap https://dzen.ru/sitemaps/slug-factory/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/suite_v2/sitemap.xml
sitemap https://dzen.ru/sitemaps/suite_v2/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/tv/sitemap.xml
sitemap https://dzen.ru/sitemaps/tv/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/news-archive/sitemap.xml
sitemap https://dzen.ru/sitemaps/news-archive/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/news-region/sitemap.xml
sitemap https://dzen.ru/sitemaps/news-region/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/news-rubric/sitemap.xml
sitemap https://dzen.ru/sitemaps/news-rubric/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/news-runtime/sitemap.xml
sitemap https://dzen.ru/sitemaps/news-runtime/sitemap.xml.gz
sitemap https://dzen.ru/sitemaps/meta-channel_v2/sitemap.xml
sitemap https://dzen.ru/sitemaps/meta-channel_v2/sitemap.xml.gz

Warnings

  • `clean-param` is not a known field.