hse.ru
robots.txt
Robots Exclusion Standard data for hse.ru
Resource Scan
Scan Details
| Site Domain | hse.ru |
| Base Domain | hse.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-21T01:28:46+00:00 |
| Next Scan | 2024-10-05T01:28:46+00:00 |
Last Scan
| Scanned | 2024-09-21T01:28:46+00:00 |
| URL | https://hse.ru/robots.txt |
| Redirect | https://www.hse.ru/robots.txt |
| Redirect Domain | www.hse.ru |
| Redirect Base | hse.ru |
| Domain IPs | 178.248.234.104 |
| Redirect IPs | 178.248.234.104 |
| Response IP | 178.248.234.104 |
| Found | Yes |
| Hash | efc825f4eb0695352d52b54682e219825bc33ebea6ca98694850c42eb7ebdcf0 |
| SimHash | 0195dce4a037 |
Groups
*
*
| Rule | Path |
|---|---|
| Disallow | */db/ |
| Disallow | */search/ |
| Disallow | */captcha/ |
| Disallow | /*empty.html |
| Disallow | */reg |
| Disallow | */user/ |
| Disallow | */adm/ |
| Disallow | */text/image |
| Disallow | */co-auth/ |
| Disallow | */schoolstat/ |
| Disallow | */pubs/lib/ajax/ |
| Disallow | */mirror/pubs/lib/ajax/ |
| Disallow | */lib/ajax/ |
| Disallow | */mirror/lib/ajax/ |
| Disallow | */ajax/ |
| Disallow | */announcement/new/ |
| Disallow | */data/xf/ |
| Disallow | /pubs/?category |
| Disallow | */expresspolls/poll/ |
| Disallow | /video/*?* |
| Disallow | */news/archive/* |
| Disallow | /?_r* |
| Disallow | /org/persons/?elib=* |
| Disallow | /n/api/counter |
| Disallow | /en/docs/ |
| Disallow | /api/ep-passport/schedule/* |
| Disallow | *?_ga* |
| Disallow | *?search_person* |
| Disallow | */n/web/playground* |
| Disallow | */n/web/playground/* |
| Disallow | */?utm_source= |
| Disallow | */openedu/api/* |
| Disallow | /*print%3D |
| Disallow | /*v%3D |
| Disallow | /*continueFlag%3D |
| Disallow | /*kw%3D |
| Disallow | /*tab%3D |
| Disallow | /*_anchor%3D |
| Disallow | /*r%3D |
| Disallow | /*_r%3D |
| Disallow | /*end_date%3D |
| Disallow | /*julian%3D |
| Disallow | /*start_date%3D |
| Disallow | /*draft%3D |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
googlebot
| Rule | Path |
|---|---|
| Disallow | */db/ |
| Disallow | */search/ |
| Disallow | */captcha/ |
| Disallow | /*empty.html |
| Disallow | */reg |
| Disallow | */user/ |
| Disallow | */adm/ |
| Disallow | */text/image |
| Disallow | */co-auth/ |
| Disallow | */schoolstat/ |
| Disallow | */pubs/lib/ajax/ |
| Disallow | */mirror/pubs/lib/ajax/ |
| Disallow | */lib/ajax/ |
| Disallow | */mirror/lib/ajax/ |
| Disallow | */ajax/ |
| Disallow | */announcement/new/ |
| Disallow | */data/xf/ |
| Disallow | /pubs/?category |
| Disallow | */expresspolls/poll/ |
| Disallow | /video/*?* |
| Disallow | */news/archive/* |
| Disallow | /?_r* |
| Disallow | /org/persons/?elib=* |
| Disallow | /n/api/counter |
| Disallow | /en/docs/ |
| Disallow | /api/ep-passport/schedule/* |
| Disallow | *?_ga* |
| Disallow | *?search_person* |
| Disallow | */n/web/playground* |
| Disallow | */n/web/playground/* |
| Disallow | */?utm_source= |
| Disallow | */openedu/api/* |
| Disallow | /*print%3D |
| Disallow | /*v%3D |
| Disallow | /*continueFlag%3D |
| Disallow | /*kw%3D |
| Disallow | /*tab%3D |
| Disallow | /*_anchor%3D |
| Disallow | /*r%3D |
| Disallow | /*_r%3D |
| Disallow | /*end_date%3D |
| Disallow | /*julian%3D |
| Disallow | /*start_date%3D |
| Disallow | /*draft%3D |
yandex
| Rule | Path |
|---|---|
| Disallow | */db/ |
| Disallow | */search/ |
| Disallow | */captcha/ |
| Disallow | /*empty.html |
| Disallow | */reg |
| Disallow | */user/ |
| Disallow | */adm/ |
| Disallow | */text/image |
| Disallow | */co-auth/ |
| Disallow | */schoolstat/ |
| Disallow | */pubs/lib/ajax/ |
| Disallow | */mirror/pubs/lib/ajax/ |
| Disallow | */lib/ajax/ |
| Disallow | */mirror/lib/ajax/ |
| Disallow | */ajax/ |
| Disallow | */announcement/new/ |
| Disallow | */data/xf/ |
| Disallow | /pubs/?category |
| Disallow | */expresspolls/poll/ |
| Disallow | /video/*?* |
| Disallow | /?_r* |
| Disallow | /org/persons/?elib=* |
| Disallow | /n/api/counter |
| Disallow | /en/docs/ |
| Disallow | */news/archive/* |
| Disallow | /api/ep-passport/schedule/* |
| Disallow | *?_ga* |
| Disallow | *?search_person* |
| Disallow | */n/web/playground* |
| Disallow | */n/web/playground/* |
| Disallow | */?utm_source= |
| Disallow | */openedu/api/* |
| Disallow | /*print%3D |
| Disallow | /*v%3D |
| Disallow | /*continueFlag%3D |
| Disallow | /*kw%3D |
| Disallow | /*tab%3D |
| Disallow | /*_anchor%3D |
| Disallow | /*r%3D |
| Disallow | /*_r%3D |
| Disallow | /*end_date%3D |
| Disallow | /*julian%3D |
| Disallow | /*start_date%3D |
| Disallow | /*draft%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hse.ru/ma/intelligence/sitemap_auto.xml |
Warnings
- `clean-param` is not a known field.