cs.hse.ru
robots.txt
Robots Exclusion Standard data for cs.hse.ru
Resource Scan
Scan Details
| Site Domain | cs.hse.ru |
| Base Domain | hse.ru |
| Scan Status | Ok |
| Last Scan | 2025-09-07T18:49:41+00:00 |
| Next Scan | 2025-09-21T18:49:41+00:00 |
Last Scan
| Scanned | 2025-09-07T18:49:41+00:00 |
| URL | https://cs.hse.ru/robots.txt |
| Domain IPs | 178.248.234.104 |
| Response IP | 178.248.234.104 |
| Found | Yes |
| Hash | 4d1352d0dc93f6da3982278eb676dc0efaea8b6e99d8db9c65bc853fd06328ed |
| SimHash | 0396dce0a033 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */mmo/diplomas/* |
| Disallow | */db/ |
| Disallow | */search/ |
| Disallow | */captcha/ |
| Disallow | /*empty.html |
| Disallow | */reg |
| Disallow | */user/ |
| Disallow | */adm/ |
| Disallow | */text/image |
| Disallow | */co-auth/ |
| Disallow | */schoolstat/ |
| Disallow | */pubs/lib/ajax/ |
| Disallow | */mirror/pubs/lib/ajax/ |
| Disallow | */lib/ajax/ |
| Disallow | */mirror/lib/ajax/ |
| Disallow | */ajax/ |
| Disallow | */announcement/new/ |
| Disallow | */data/xf/ |
| Disallow | /pubs/?category |
| Disallow | */expresspolls/poll/ |
| Disallow | /video/*?* |
| Disallow | */news/archive/* |
| Disallow | /?_r* |
| Disallow | /org/persons/?elib=* |
| Disallow | /n/api/counter |
| Disallow | /en/docs/ |
| Disallow | /api/ep-passport/schedule/* |
| Disallow | *?_ga* |
| Disallow | *?search_person* |
| Disallow | */n/web/playground* |
| Disallow | */n/web/playground/* |
| Disallow | */?utm_source= |
| Disallow | */openedu/api/* |
| Disallow | /*print%3D |
| Disallow | /*v%3D |
| Disallow | /*continueFlag%3D |
| Disallow | /*kw%3D |
| Disallow | /*tab%3D |
| Disallow | /*_anchor%3D |
| Disallow | /*r%3D |
| Disallow | /*_r%3D |
| Disallow | /*end_date%3D |
| Disallow | /*julian%3D |
| Disallow | /*start_date%3D |
| Disallow | /*draft%3D |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
googlebot
| Rule | Path |
|---|---|
| Disallow | */mmo/diplomas/* |
| Disallow | */db/ |
| Disallow | */search/ |
| Disallow | */captcha/ |
| Disallow | /*empty.html |
| Disallow | */reg |
| Disallow | */user/ |
| Disallow | */adm/ |
| Disallow | */text/image |
| Disallow | */co-auth/ |
| Disallow | */schoolstat/ |
| Disallow | */pubs/lib/ajax/ |
| Disallow | */mirror/pubs/lib/ajax/ |
| Disallow | */lib/ajax/ |
| Disallow | */mirror/lib/ajax/ |
| Disallow | */ajax/ |
| Disallow | */announcement/new/ |
| Disallow | */data/xf/ |
| Disallow | /pubs/?category |
| Disallow | */expresspolls/poll/ |
| Disallow | /video/*?* |
| Disallow | */news/archive/* |
| Disallow | /?_r* |
| Disallow | /org/persons/?elib=* |
| Disallow | /n/api/counter |
| Disallow | /en/docs/ |
| Disallow | /api/ep-passport/schedule/* |
| Disallow | *?_ga* |
| Disallow | *?search_person* |
| Disallow | */n/web/playground* |
| Disallow | */n/web/playground/* |
| Disallow | */?utm_source= |
| Disallow | */openedu/api/* |
| Disallow | /*print%3D |
| Disallow | /*v%3D |
| Disallow | /*continueFlag%3D |
| Disallow | /*kw%3D |
| Disallow | /*tab%3D |
| Disallow | /*_anchor%3D |
| Disallow | /*r%3D |
| Disallow | /*_r%3D |
| Disallow | /*end_date%3D |
| Disallow | /*julian%3D |
| Disallow | /*start_date%3D |
| Disallow | /*draft%3D |
yandex
| Rule | Path |
|---|---|
| Disallow | */mmo/diplomas/* |
| Disallow | */db/ |
| Disallow | */search/ |
| Disallow | */captcha/ |
| Disallow | /*empty.html |
| Disallow | */reg |
| Disallow | */user/ |
| Disallow | */adm/ |
| Disallow | */text/image |
| Disallow | */co-auth/ |
| Disallow | */schoolstat/ |
| Disallow | */pubs/lib/ajax/ |
| Disallow | */mirror/pubs/lib/ajax/ |
| Disallow | */lib/ajax/ |
| Disallow | */mirror/lib/ajax/ |
| Disallow | */ajax/ |
| Disallow | */announcement/new/ |
| Disallow | */data/xf/ |
| Disallow | /pubs/?category |
| Disallow | */expresspolls/poll/ |
| Disallow | /video/*?* |
| Disallow | /?_r* |
| Disallow | /org/persons/?elib=* |
| Disallow | /n/api/counter |
| Disallow | /en/docs/ |
| Disallow | */news/archive/* |
| Disallow | /api/ep-passport/schedule/* |
| Disallow | *?_ga* |
| Disallow | *?search_person* |
| Disallow | */n/web/playground* |
| Disallow | */n/web/playground/* |
| Disallow | */?utm_source= |
| Disallow | */openedu/api/* |
| Disallow | /*print%3D |
| Disallow | /*v%3D |
| Disallow | /*continueFlag%3D |
| Disallow | /*kw%3D |
| Disallow | /*tab%3D |
| Disallow | /*_anchor%3D |
| Disallow | /*r%3D |
| Disallow | /*_r%3D |
| Disallow | /*end_date%3D |
| Disallow | /*julian%3D |
| Disallow | /*start_date%3D |
| Disallow | /*draft%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cs.hse.ru/robotics/sitemap_auto.xml |
Warnings
- `clean-param` is not a known field.