dkvartal.ru
robots.txt

Robots Exclusion Standard data for dkvartal.ru

Resource Scan

Scan Details

Site Domain dkvartal.ru
Base Domain dkvartal.ru
Scan Status Ok
Last Scan2024-09-25T22:03:50+00:00
Next Scan 2024-10-02T22:03:50+00:00

Last Scan

Scanned2024-09-25T22:03:50+00:00
URL http://dkvartal.ru/robots.txt
Redirect https://www.dk.ru/robots.txt
Redirect Domain www.dk.ru
Redirect Base dk.ru
Domain IPs 89.108.123.186
Redirect IPs 89.108.123.186
Response IP 89.108.123.186
Found Yes
Hash b6ecf86b6cba6d2a67e73d2e48ed6f06b49d0f1d550e12e80f6e7a316ec729bf
SimHash ed4dc8535d71

Groups

yandex

Rule Path
Allow /news/yandex-rss.xml
Allow /news/yandex-zen-rss.xml
Disallow /preview_news
Disallow /add_hit
Disallow /editorial_news_binding_hit
Disallow /news_thematic_rubric_hits
Disallow /community_add_hit
Disallow /participant_add_hit
Disallow /search
Disallow /magazine_subscription/create
Disallow /users
Disallow /password
Disallow /amp
Disallow /session
Disallow /opinion

googlebot

Rule Path
Allow /news/google-sitemap.xml
Allow /news/google-rss.xml
Disallow /preview_news
Disallow /add_hit
Disallow /editorial_news_binding_hit
Disallow /news_thematic_rubric_hits
Disallow /community_add_hit
Disallow /participant_add_hit
Disallow /search
Disallow /magazine_subscription/create
Disallow /users
Disallow /password
Disallow /session
Disallow /opinion

*

Rule Path
Disallow /preview_news
Disallow /add_hit
Disallow /editorial_news_binding_hit
Disallow /news_thematic_rubric_hits
Disallow /community_add_hit
Disallow /participant_add_hit
Disallow /search
Disallow /magazine_subscription/create
Disallow /users
Disallow /password
Disallow /session
Disallow /opinion

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dk.ru/sitemap.xml
sitemap https://www.dk.ru/news/google-sitemap.xml
sitemap https://www.dk.ru/google_sitemaps/sitemap.xml
sitemap https://www.dk.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.