provoronezh.ru
robots.txt

Robots Exclusion Standard data for provoronezh.ru

Resource Scan

Scan Details

Site Domain provoronezh.ru
Base Domain provoronezh.ru
Scan Status Ok
Last Scan2024-11-09T09:36:27+00:00
Next Scan 2024-11-16T09:36:27+00:00

Last Scan

Scanned2024-11-09T09:36:27+00:00
URL https://provoronezh.ru/robots.txt
Redirect https://voronezh1.ru/robots.txt
Redirect Domain voronezh1.ru
Redirect Base voronezh1.ru
Domain IPs 195.19.220.26
Redirect IPs 195.19.220.26
Response IP 195.19.220.26
Found Yes
Hash 286057ff6fb6a6fd2b0339f4c848b18f5a615769ac97d9a03f58cb04fb883b25
SimHash 1a155820f3f7

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

mail.ru

Rule Path
Allow */?from=yanews
Allow /rss-feeds/zen-news.xml

zen_bot/2.0

Rule Path
Allow *?utm_source=
Allow *?from=
Allow /text/yandex-news.region.xml
Allow /rss-feeds/zen-news.xml
Allow /rss-feeds/zen-news-webmaster.xml

yandexnews

Rule Path
Allow */yanews/
Allow /rss/yandex/
Allow *?from=yanews
Allow *?utm_source=
Allow /text/yandex-news.region.xml
Allow /rss-feeds/zen-news.xml
Allow /rss-feeds/zen-news-webmaster.xml

*

Rule Path
Disallow */search
Disallow */comments/
Disallow /market/
Disallow /feedback/
Disallow /gm-api/
Disallow /quizzes/
Allow /html-to-img/
Disallow /help/
Disallow /pages/
Disallow /site_map/
Disallow /passport/
Disallow *page%3D1
Disallow *discuss%3D
Disallow *full%3D
Disallow */?share
Disallow /?
Disallow */?ngs_token=
Disallow */?dateFrom=
Disallow */*%26dateFrom%3D
Disallow */?set_cookie=
Disallow */?recordId=
Disallow *%26regionId%3D
Disallow *%26shareCard%3D
Disallow *?previewToken=
Disallow *?_
Disallow */?*points=
Disallow */?*quizResult=
Disallow */?*toQuiz=
Disallow */?*m=
Disallow */?*u=
Allow /rss-feeds/zen-news.xml
Allow /rss-feeds/zen-news-webmaster.xml
Disallow *?mindbox-message-key=
Disallow *?from=
Disallow *?utm_
Disallow *?amp
Disallow *?*etext=
Disallow *?startedAtGte=
Disallow *?place=
Disallow *?kids=
Disallow *?*free=
Disallow /afisha/all-events/
Disallow /afisha/cinema-events/
Disallow /afisha/concert-events/
Disallow /afisha/theatre-events/
Disallow /afisha/kids-events/
Disallow /afisha/sport-events/
Disallow /afisha/art-events/
Disallow /afisha/other-events/

Other Records

Field Value
sitemap https://voronezh1.ru/sitemaps/index.xml.gz
sitemap https://voronezh1.ru/exchange/sitemap.xml

Comments

  • 1
  • 2
  • 3
  • 5-afisha

Warnings

  • `clean-param` is not a known field.