fontanka.ru
robots.txt

Robots Exclusion Standard data for fontanka.ru

Resource Scan

Scan Details

Site Domain fontanka.ru
Base Domain fontanka.ru
Scan Status Ok
Last Scan2024-05-03T13:03:31+00:00
Next Scan 2024-05-10T13:03:31+00:00

Last Scan

Scanned2024-05-03T13:03:31+00:00
URL https://fontanka.ru/robots.txt
Redirect https://www.fontanka.ru/robots.txt
Redirect Domain www.fontanka.ru
Redirect Base fontanka.ru
Domain IPs 195.19.220.21
Redirect IPs 195.19.220.21
Response IP 195.19.220.21
Found Yes
Hash d8b60574b79b7019b37c4c75106bc8149dd13c4ae5ea021fe664efec72cf4378
SimHash 4e24d121b143

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

yandexadditional

Rule Path
Disallow /

zen_bot/2.0

Rule Path
Allow *?from=
Allow *?utm_source=
Allow /__forYandex/last/for_yandex.xml
Allow /fontanka/last/for_yandex_zen_total.xml

yandexnews

Rule Path
Allow *?from=
Allow */yanews/
Allow /rss/yandex/
Allow *?utm_source=
Allow /__forYandex/last/for_yandex.xml
Allow /fontanka/last/for_yandex_zen_total.xml

yandex

Rule Path
Allow /fontanka/last/for_yandex_zen_total.xml
Disallow /allcomments.html
Disallow /currency.html?
Disallow /cgi-bin/
Disallow /search.html?
Disallow /www-include/
Disallow /pic/decor/
Disallow /users/
Disallow /subscription/
Disallow /subscriptions/
Disallow /subscription_promo/
Disallow /gm-api/
Disallow /quizzes/
Disallow *?
Allow *?erid=
Allow /__forYandex/last/for_yandex.xml
Allow /fontanka/last/for_yandex_zen_total.xml
Disallow */m.html$
Disallow */print.html$
Disallow */index.html$
Disallow */pda.html$
Disallow */all.html$
Disallow */news.html$
Disallow */article.html$
Disallow */fotoreport.html$
Disallow */businews.html$
Disallow /__site/
Disallow *all.comments.m.html$
Disallow */all.comments.html
Disallow *big.*.html$
Disallow *map.*.html$
Disallow *report.*.html$
Disallow *picture.*.html$
Disallow *infograph.*.html$
Disallow /*/print.html
Disallow /*/pda.html
Disallow /*/fotoreport.html
Disallow /*/for_twitter.xml
Disallow */24hours.html$
Disallow */24hours_news.html$
Disallow */24hours_articles.html$
Disallow */24hours_article.html$
Disallow */articles.html$
Disallow /afisha/all-events/
Disallow /afisha/cinema-events/
Disallow /afisha/concert-events/
Disallow /afisha/theatre-events/
Disallow /afisha/kids-events/
Disallow /afisha/sport-events/
Disallow /afisha/art-events/
Disallow /afisha/other-events/

*

Rule Path
Disallow /allcomments.html
Disallow /currency.html?
Disallow /cgi-bin/
Disallow /search.html?
Disallow /www-include/
Disallow /pic/decor/
Disallow /users/
Disallow /subscription/
Disallow /subscriptions/
Disallow /subscription_promo/
Disallow /gm-api/
Disallow /quizzes/
Disallow *?
Allow *?erid=
Allow /__forYandex/last/for_yandex.xml
Allow /fontanka/last/for_yandex_zen_total.xml
Disallow */m.html$
Disallow */print.html$
Disallow */index.html$
Disallow */pda.html$
Disallow */all.html$
Disallow */news.html$
Disallow */article.html$
Disallow */fotoreport.html$
Disallow */businews.html$
Disallow /__site/
Disallow *all.comments.m.html$
Disallow */all.comments.html
Disallow *big.*.html$
Disallow *map.*.html$
Disallow *report.*.html$
Disallow *picture.*.html$
Disallow *infograph.*.html$
Disallow /*/print.html
Disallow /*/pda.html
Disallow /*/fotoreport.html
Disallow /*/for_twitter.xml
Disallow */24hours.html$
Disallow */24hours_news.html$
Disallow */24hours_articles.html$
Disallow */24hours_article.html$
Disallow */articles.html$
Disallow /afisha/all-events/
Disallow /afisha/cinema-events/
Disallow /afisha/concert-events/
Disallow /afisha/theatre-events/
Disallow /afisha/kids-events/
Disallow /afisha/sport-events/
Disallow /afisha/art-events/
Disallow /afisha/other-events/

Other Records

Field Value
sitemap https://www.fontanka.ru/sitemap.xml

Comments

  • 1
  • 2
  • 4
  • 5-afisha
  • 1
  • 2
  • 4
  • 5-afisha

Warnings

  • `clean-param` is not a known field.