Log In Sign Up

dk.ru
robots.txt

Robots Exclusion Standard data for dk.ru

Resource Scan

Scan Details

Site Domain dk.ru
Base Domain dk.ru
Scan Status Ok
Last Scan2024-06-05T04:59:42+00:00
Next Scan 2024-06-12T04:59:42+00:00

Last Scan

Scanned2024-06-05T04:59:42+00:00
URL https://dk.ru/robots.txt
Redirect https://www.dk.ru/robots.txt
Redirect Domain www.dk.ru
Redirect Base dk.ru
Domain IPs 89.108.123.186
Redirect IPs 89.108.123.186
Response IP 89.108.123.186
Found Yes
Hash 28ee09c3a1fb13f03b574d720eb94e36d50ea827bf6055c9f7cad05e82f766ed
SimHash fd0dc1535df1

Groups

yandex

Rule Path
Allow /news/yandex-rss.xml
Allow /news/yandex-zen-rss.xml
Disallow /preview_news
Disallow /add_hit
Disallow /editorial_news_binding_hit
Disallow /news_thematic_rubric_hits
Disallow /community_add_hit
Disallow /participant_add_hit
Disallow /search
Disallow /magazine_subscription/create
Disallow /users
Disallow /password
Disallow /amp
Disallow /session
Disallow /opinion

googlebot

Rule Path
Allow /news/google-sitemap.xml
Allow /news/google-rss.xml
Disallow /preview_news
Disallow /add_hit
Disallow /editorial_news_binding_hit
Disallow /news_thematic_rubric_hits
Disallow /community_add_hit
Disallow /participant_add_hit
Disallow /search
Disallow /magazine_subscription/create
Disallow /users
Disallow /password
Disallow /session
Disallow /opinion

*

Rule Path
Disallow /preview_news
Disallow /add_hit
Disallow /editorial_news_binding_hit
Disallow /news_thematic_rubric_hits
Disallow /community_add_hit
Disallow /participant_add_hit
Disallow /search
Disallow /magazine_subscription/create
Disallow /users
Disallow /password
Disallow /session
Disallow /opinion
Back to top

Other Records

Field Value
sitemap https://www.dk.ru/sitemap.xml
sitemap https://www.dk.ru/news/google-sitemap.xml
sitemap https://www.dk.ru/google_sitemaps/sitemap.xml
sitemap https://www.dk.ru/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
Back to top