marieclaire.ru
robots.txt

Robots Exclusion Standard data for marieclaire.ru

Resource Scan

Scan Details

Site Domain marieclaire.ru
Base Domain marieclaire.ru
Scan Status Ok
Last Scan2024-05-10T17:47:45+00:00
Next Scan 2024-05-17T17:47:45+00:00

Last Scan

Scanned2024-05-10T17:47:45+00:00
URL https://marieclaire.ru/robots.txt
Redirect https://www.marieclaire.ru/robots.txt
Redirect Domain www.marieclaire.ru
Redirect Base marieclaire.ru
Domain IPs 195.226.222.195
Redirect IPs 195.226.222.195
Response IP 195.226.222.195
Found Yes
Hash 1e1095ce577b269af18990ed3ccdbc4e3ba458634b57471c5678cf4548c32635
SimHash 31181d33aba7

Groups

zen_bot/2.0

Rule Path
Allow *?utm_source=
Allow *?from=
Allow /rss-feeds/yanews.xml

yandexnews

Rule Path
Allow */yanews/
Allow /rss/yandex/
Allow *?from=yanews
Allow *?utm_source=
Allow /rss-feeds/yanews.xml

*

Rule Path
Disallow /cache/*
Disallow /search/*
Disallow /index/*
Disallow /users/*
Disallow /articles/*
Disallow /theme/1*
Disallow /peb/*
Disallow /admin
Disallow /test_razdel
Disallow /test_subrazdel
Disallow /test_article
Disallow /test_index
Disallow /stil-zjizny/prazdnik-kotoryiy-vsegda-s-toboy
Disallow /*?page=*
Disallow /*%26page%3D*
Disallow /*?day*
Disallow /authors
Disallow /*utm_source%3D
Disallow /mobile-app
Disallow *?previewToken=*
Disallow *scroogePreview_creativeId%3D
Disallow /gm-api/*
Disallow */result/*
Disallow /mcatwork
Disallow /privacypolicy/
Disallow *?
Disallow */%26
Disallow /insta/
Disallow /useragreement/
Disallow /unsubscribe/
Disallow */yanews/
Disallow /pages/
Disallow /moda/russkii-stil-tradicii-kultura-i-lyudi-kotorye-sozdali-unikalnuyu-modu-v-rossii/
Disallow /gm-api/
Disallow /81006599/
Disallow /22729373807/

Other Records

Field Value
sitemap https://www.marieclaire.ru/sitemaps/index.xml.gz

Warnings

  • `clean-param` is not a known field.