doctorpiter.ru
robots.txt

Robots Exclusion Standard data for doctorpiter.ru

Resource Scan

Scan Details

Site Domain doctorpiter.ru
Base Domain doctorpiter.ru
Scan Status Ok
Last Scan2024-05-22T16:27:13+00:00
Next Scan 2024-05-29T16:27:13+00:00

Last Scan

Scanned2024-05-22T16:27:13+00:00
URL https://doctorpiter.ru/robots.txt
Domain IPs 195.226.222.231
Response IP 195.226.222.231
Found Yes
Hash b48a524a0c94e1588fe70282cfd04ccab421a429cc14dee1da19a06b6020598a
SimHash 5c1c3d45ff08

Groups

zen_bot/2.0

Rule Path
Allow *?utm_source=
Allow *?from=
Allow /rss-feeds/yanews.xml

yandexnews

Rule Path
Allow */yanews/
Allow /rss/yandex/
Allow *?from=yanews
Allow *?utm_source=
Allow /rss-feeds/yanews.xml

*

Rule Path
Disallow */search/*
Disallow /auth/*
Disallow /register
Disallow */manage/*
Disallow */comments/*
Disallow */?q=*
Disallow */?query=*
Disallow /articles/*/?*
Disallow /articles/?*
Disallow *?previewToken=*
Disallow */?rubric_id=*
Disallow /gm-api/*
Disallow /info/*/
Disallow /clinics/
Disallow /sp/*/*/
Disallow /events/
Disallow /search/
Disallow /pharmacies/
Disallow /info/
Disallow /vacancies/
Disallow /reports/
Disallow /thanks/
Disallow /api/
Disallow /documents/
Disallow /rubrics/
Disallow /longreads/
Disallow /?
Disallow */?_abp_test=
Disallow /users/
Disallow */android-app
Disallow */yanews/
Disallow */?utm_
Disallow /doctors/
Disallow */?_gl=
Disallow */?utm_
Disallow */?amp
Disallow */?symptom_id=
Disallow */?open
Disallow */?toQuiz=
Disallow */result/
Disallow /gm-api/
Disallow /81006599/
Disallow /22729373807/
Disallow /articles/8868/
Disallow /polls/
Disallow /slideshows/
Disallow *?show_warn=

Other Records

Field Value
sitemap https://doctorpiter.ru/sitemaps/index.xml.gz

Warnings

  • `clean-param` is not a known field.