unibe.ch
robots.txt
Robots Exclusion Standard data for unibe.ch
Resource Scan
Scan Details
| Site Domain | unibe.ch |
| Base Domain | unibe.ch |
| Scan Status | Ok |
| Last Scan | 2024-06-22T04:46:59+00:00 |
| Next Scan | 2024-07-06T04:46:59+00:00 |
Last Scan
| Scanned | 2024-06-22T04:46:59+00:00 |
| URL | https://unibe.ch/robots.txt |
| Redirect | https://www.unibe.ch/robots.txt |
| Redirect Domain | www.unibe.ch |
| Redirect Base | unibe.ch |
| Domain IPs | 130.92.250.6, 2001:620:400:2500::6 |
| Redirect IPs | 130.92.250.6, 2001:620:400:2500::6 |
| Response IP | 130.92.250.6 |
| Found | Yes |
| Hash | 9e5aaf9ad20da39c92ed87bea132a7c27c0054ed617c8cd2b322a521ba48e8e8 |
| SimHash | d84487e75d91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /error |
| Disallow | /icons |
| Disallow | /ajax_getPageContent |
| Disallow | /getJSONSchema |
| Disallow | */manage |
| Disallow | /*?preview=preview$ |
| Disallow | /*?preview$ |
| Disallow | /*preview_html |
| Disallow | /*sitemap_ger.html$ |
| Disallow | /*sitemap_eng.html$ |
| Disallow | /*sitemap_fra.html$ |
| Disallow | /*index_print_ger.html$ |
| Disallow | /*index_print_eng.html$ |
| Disallow | /*index_print_fra.html$ |
| Disallow | /*search_ger.html$ |
| Disallow | /*search_eng.html$ |
| Disallow | /*search_fra.html$ |
| Disallow | /*nav_portal_ger.html$ |
| Disallow | /*nav_portal_fra.html$ |
| Disallow | /*nav_portal_eng.html$ |
| Disallow | /*nav_uniintern_ger.html$ |
| Disallow | /*nav_uniintern_fra.html$ |
| Disallow | /*nav_uniintern_eng.html$ |
| Disallow | /*catalog_ger$ |
| Disallow | /*catalog_eng$ |
| Disallow | /*catalog_fra$ |
| Disallow | /*index_access |
| Disallow | /*manage$ |
| Disallow | /*manage?lang=ger$ |
| Disallow | /*manage?lang=eng$ |
| Disallow | /*manage?lang=fra$ |
| Disallow | /*manage_main$ |
| Disallow | /*f_zoomImage |
mozilla/5.0 (compatible; ahrefssiteaudit/6.1; +http://ahrefs.com/robot/site-audit)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; ahrefsbot/7.0; ahrefssiteaudit; +http://ahrefs.com/robot/)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; ahrefsbot/2.0; +http://ahrefs.com/robot/),gzip(gfe) (via docs.google.com/viewer)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible) facebookexternalhit/1.1 (+https://faviconkit.com/robots)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (macintosh; intel mac os x 10_11_1) applewebkit/601.2.4 (khtml, like gecko) version/9.0.1 safari/601.2.4 facebookexternalhit/1.1 facebot twitterbot/1.0
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; the lounge irc client; +https://github.com/thelounge/thelounge) facebookexternalhit/1.1 twitterbot/1.0
| Rule | Path |
|---|---|
| Disallow | / |
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) _zbot
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (macintosh; intel mac os x 10_11_1) applewebkit/601.2.4 (khtml, like gecko) version/9.0.1 safari/601.2.4 facebookexternalhit/1.1 facebot twitterbot/1.0,gzip(gfe)
| Rule | Path |
|---|---|
| Disallow | / |
getstream.io/opengraph-bot (like twitterbot) facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
| Rule | Path |
|---|---|
| Disallow | / |
http.rb/5.1.1 (mastodon/4.3.0-alpha.1+glitch.cortex; +https://corteximplant.com/) bot
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; yandexrenderresourcesbot/1.0; +http://yandex.com/bots) applewebkit/537.36 (khtml, like gecko) chrome/108.0.0.0
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; yandexbot/3.0; +http://yandex.com/bots) applewebkit/537.36 (khtml, like gecko) chrome/108.0.0.0
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; yandexrenderresourcesbot/1.0; +http://yandex.com/bots) applewebkit/537.36 (khtml, like gecko) chrome/81.0.4044.268
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; yandexbot/3.0; +http://yandex.com/bots) applewebkit/537.36 (khtml, like gecko) chrome/81.0.4044.268
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (iphone; cpu iphone os 8_1 like mac os x) applewebkit/600.1.4 (khtml, like gecko) version/8.0 mobile/12b411 safari/600.1.4 (compatible; yandexmobilebot/3.0; +http://yandex.com/bots)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; yandexaccessibilitybot/3.0; +http://yandex.com/bots) applewebkit/537.36 (khtml, like gecko) chrome/81.0.4044.268
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (compatible; yandexaccessibilitybot/3.0; +http://yandex.com/bots) applewebkit/537.36 (khtml, like gecko) chrome/108.0.0.0
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (iphone; cpu iphone os 15_4_1 like mac os x) applewebkit/605.1.15 (khtml, like gecko) version/15.4 mobile/15e148 safari/604.1 (compatible; yandexmobilebot/3.0; +http://yandex.com/bots)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (linux; android 6.0.1; sm-g570f build/mmb29k) applewebkit/537.36 (khtml, like gecko) chrome/59.0.3071.125 mobile safari/537.36 (compatible; yandexmetrika/3.0; +http://yandex.com/bots)
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (iphone; cpu iphone os 8_1 like mac os x) applewebkit/600.1.4 (khtml, like gecko) version/8.0 mobile/12b411 safari/600.1.4 (compatible; yandexmobilebot/3.0; +http://yandex.com/bots) ytranslate
| Rule | Path |
|---|---|
| Disallow | / |