Log In Sign Up

design.hse.ru
robots.txt

Robots Exclusion Standard data for design.hse.ru

Resource Scan

Scan Details

Site Domain design.hse.ru
Base Domain hse.ru
Scan Status Ok
Last Scan2025-09-02T15:38:42+00:00
Next Scan 2025-10-02T15:38:42+00:00

Last Scan

Scanned2025-09-02T15:38:42+00:00
URL https://design.hse.ru/robots.txt
Domain IPs 82.204.188.208
Response IP 82.204.188.208
Found Yes
Hash f54de0589b8d7970e5877159330423f43bbe56d9107acc88cc0f1fba91f561da
SimHash 6384080d7274

Groups

*

Rule Path
Disallow /admin/
Disallow /dop/admin/
Disallow /dop/system/
Disallow /lab/system/
Disallow /zharkniga/system/
Disallow /lab/admin/
Disallow /enrollees/
Disallow /ckeditor/
Disallow /print.pdf
Disallow /schedule/
Disallow /contactdesign/
Disallow /brandbooks/
Disallow /news/111
Disallow /edit/
Disallow /art-gallery/
Disallow /archive/
Disallow /custom_pages/
Disallow /pages/205
Disallow /environmental-2016
Disallow /fashion-2016
Disallow /animation-2016
Disallow /communication-2016
Disallow /art-2016
Disallow /photo-2016
Disallow /programming-2016
Disallow /bak-2016
Disallow /magistracy-2016
Disallow /mag-design-2016
Disallow /mag-comm-2016
Disallow /fashion-mag-2016
Disallow /book-2016
Disallow /regional-branding-2016
Disallow /comm-basic-2016
Disallow /comm-advanced-2016
Disallow /museumdesign-2016
Disallow /magistracy2015
Disallow /edu-coding
Disallow /edu-comminication
Disallow /team/14003
Disallow /*show_popup$
Disallow /*.xlsx
Disallow /*.xls
Disallow /*.docx
Disallow /*.doc
Disallow /*.pdf*
Disallow /*?ref=*
Disallow /*?filter=*
Disallow /*?source=*
Disallow /*?yabizcmpgn=*
Disallow /*?lang=*
Disallow /*?ltclid=*
Disallow /*?request_id=*
Disallow /*?etext=*
Disallow /*?*
Disallow /*?yadclid=*
Disallow /*?tag=*
Disallow /*?external_browser_redirect=*
Disallow /dop/*apply
Disallow */apply
Disallow /schedule/
Disallow /pages/
Disallow /groups/
Disallow /alumni/
Disallow /vars/249

yandex

Rule Path
Disallow /admin/
Disallow /dop/admin/
Disallow /dop/system/
Disallow /lab/system/
Disallow /zharkniga/system/
Disallow /lab/admin/
Disallow /enrollees/
Disallow /ckeditor/
Disallow /print.pdf
Disallow /schedule/
Disallow /contactdesign/
Disallow /brandbooks/
Disallow /news/111
Disallow /edit/
Disallow /art-gallery/
Disallow /archive/
Disallow /custom_pages/
Disallow /pages/205
Disallow /environmental-2016
Disallow /fashion-2016
Disallow /animation-2016
Disallow /communication-2016
Disallow /art-2016
Disallow /photo-2016
Disallow /programming-2016
Disallow /bak-2016
Disallow /magistracy-2016
Disallow /mag-design-2016
Disallow /mag-comm-2016
Disallow /fashion-mag-2016
Disallow /book-2016
Disallow /regional-branding-2016
Disallow /comm-basic-2016
Disallow /comm-advanced-2016
Disallow /museumdesign-2016
Disallow /magistracy2015
Disallow /edu-coding
Disallow /edu-comminication
Disallow /team/14003
Disallow /*show_popup$
Disallow /*.xlsx
Disallow /*.xls
Disallow /*.docx
Disallow /*.doc
Disallow /*.pdf*
Disallow /*?ref=*
Disallow /*?filter=*
Disallow /*?source=*
Disallow /*?yabizcmpgn=*
Disallow /*?lang=*
Disallow /*?ltclid=*
Disallow /*?request_id=*
Disallow /*?etext=*
Disallow /*?*
Disallow /*?yadclid=*
Disallow /*?tag=*
Disallow /*?external_browser_redirect=*
Disallow /dop/*apply
Disallow */apply
Disallow /schedule/
Disallow /pages/
Disallow /groups/
Disallow /alumni/
Disallow /vars/249
Back to top

Other Records

Field Value
sitemap https://design.hse.ru/sitemap.xml
sitemap https://design.hse.ru/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top