www2.hu-berlin.de
robots.txt
Robots Exclusion Standard data for www2.hu-berlin.de
Resource Scan
Scan Details
| Site Domain | www2.hu-berlin.de |
| Base Domain | hu-berlin.de |
| Scan Status | Ok |
| Last Scan | 2025-10-10T12:53:26+00:00 |
| Next Scan | 2025-10-24T12:53:26+00:00 |
Last Scan
| Scanned | 2025-10-10T12:53:26+00:00 |
| URL | https://www2.hu-berlin.de/robots.txt |
| Domain IPs | 141.20.5.46 |
| Response IP | 141.20.5.46 |
| Found | Yes |
| Hash | 18c17deddf91fd4c7a40bb9a975581519a2c145f078bdecba12d4e95493717d4 |
| SimHash | 250bb965df9a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /aknoa/_privat/ |
| Disallow | /aknoa/bin/ |
| Disallow | /aknoa/newsletter/ |
| Disallow | /aknoa/temp/ |
| Disallow | /aknoa/seminar/ |
| Disallow | /aknoa/personal/ |
| Disallow | /aknoa/publications/ |
| Disallow | /aknoa/mediatheken/ |
| Disallow | /aknoa/lehre/ |
| Disallow | /aknoa/utilities/ |
*
| Rule | Path |
|---|---|
| Disallow | /bragi/b9 |
*
*
*
| Rule | Path |
|---|---|
| Disallow | /genderblog/wp-admin/ |
*
| Rule | Path |
|---|---|
| Disallow | /kuwi-aesthetik/cgi-bin/ |
| Disallow | /kuwi-aesthetik/wp-admin/ |
| Disallow | /kuwi-aesthetik/trackback/ |
| Disallow | /kuwi-aesthetik/feed/ |
| Disallow | /kuwi-aesthetik/comments/ |
*
*
| Rule | Path |
|---|---|
| Disallow | /personalstatistik/ |
*
| Rule | Path |
|---|---|
| Disallow | /predicate_focus_africa/gfx/ |
| Disallow | /predicate_focus_africa/data/ |
| Disallow | /predicate_focus_africa/logs/ |
*
*
| Rule | Path |
|---|---|
| Disallow | /uhk-reichsarbeitsministerium/core/ |
| Disallow | /uhk-reichsarbeitsministerium/profiles/ |
| Disallow | /uhk-reichsarbeitsministerium/README.txt |
| Disallow | /uhk-reichsarbeitsministerium/web.config |
| Disallow | /uhk-reichsarbeitsministerium/admin/ |
| Disallow | /uhk-reichsarbeitsministerium/comment/reply/ |
| Disallow | /uhk-reichsarbeitsministerium/filter/tips |
| Disallow | /uhk-reichsarbeitsministerium/node/add/ |
| Disallow | /uhk-reichsarbeitsministerium/search/ |
| Disallow | /uhk-reichsarbeitsministerium/user/register |
| Disallow | /uhk-reichsarbeitsministerium/user/password |
| Disallow | /uhk-reichsarbeitsministerium/user/login |
| Disallow | /uhk-reichsarbeitsministerium/user/logout |
| Disallow | /uhk-reichsarbeitsministerium/media/oembed |
| Disallow | /uhk-reichsarbeitsministerium/*/media/oembed |
| Disallow | /uhk-reichsarbeitsministerium/index.php/admin/ |
| Disallow | /uhk-reichsarbeitsministerium/index.php/comment/reply/ |
| Disallow | /uhk-reichsarbeitsministerium/index.php/filter/tips |
| Disallow | /uhk-reichsarbeitsministerium/index.php/node/add/ |
| Disallow | /uhk-reichsarbeitsministerium/index.php/search/ |
| Disallow | /uhk-reichsarbeitsministerium/index.php/user/password |
| Disallow | /uhk-reichsarbeitsministerium/index.php/user/register |
| Disallow | /uhk-reichsarbeitsministerium/index.php/user/login |
| Disallow | /uhk-reichsarbeitsministerium/index.php/user/logout |
| Disallow | /uhk-reichsarbeitsministerium/index.php/media/oembed |
| Disallow | /uhk-reichsarbeitsministerium/index.php/*/media/oembed |
*
| Rule | Path |
|---|---|
| Disallow | /wids/logs/ |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /statistik/ |
| Disallow | /stadtplan/ |
| Disallow | /webstats/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www2.hu-berlin.de/internal/sitemap.xml |
Comments