uni-koeln.de
robots.txt
Robots Exclusion Standard data for uni-koeln.de
Resource Scan
Scan Details
Site Domain | uni-koeln.de |
Base Domain | uni-koeln.de |
Scan Status | Ok |
Last Scan | 2024-09-23T22:12:58+00:00 |
Next Scan | 2024-10-07T22:12:58+00:00 |
Last Scan
Scanned | 2024-09-23T22:12:58+00:00 |
URL | https://uni-koeln.de/robots.txt |
Domain IPs | 134.95.81.52, 2a00:a200:0:2::80 |
Response IP | 134.95.81.52 |
Found | Yes |
Hash | 80d25a7b01b77b9837952823525846470b7ee30c7dc4247333e05ca998dbbf6f |
SimHash | a865ab02a7c0 |
Groups
*
Product | Comment |
---|---|
* | All other spiders should avoid |
Rule | Path | Comment |
---|---|---|
Disallow | /cgi-bin/ | Script files |
Disallow | /bin2/ | Script files |
Disallow | /bin3/ | Script files |
Disallow | /kurs-bin/ | Script files |
Disallow | /htdig/ | Script files |
Disallow | /admin/ | - |
Disallow | /experimente/ | - |
Disallow | /intern/ | - |
Disallow | /extern/ | - |
Disallow | /kiosk/ | - |
Disallow | /rrzk/org/mitarbeiter/ | - |
Disallow | /wiso-fak/szyperski/intern/ | - |
Disallow | /phil-fak/phil/org/aktuell.htm | - |
Disallow | /med-fak/auge/mitarbeiter.html | - |
Disallow | /rrzk/software/fachspezifisch/Biologie-Genetik/wispact/ | - |
Disallow | /rrzk/Abt-Systeme/ | - |
Disallow | /rrzk/systeme/SFgate/ | - |
Disallow | /rrzk/systeme/WWW/ | - |
Disallow | /rrzk/systeme/cgi-bin/ | - |
Disallow | /rrzk/systeme/dec/ | - |
Disallow | /rrzk/systeme/hp/ | - |
Disallow | /rrzk/systeme/htbin/ | - |
Disallow | /rrzk/systeme/ibm/ | - |
Disallow | /rrzk/systeme/intern/ | - |
Disallow | /rrzk/systeme/microsoft/ | - |
Disallow | /rrzk/systeme/nt/ | - |
Disallow | /rrzk/systeme/os2/ | - |
Disallow | /rrzk/systeme/sgi/ | - |
Disallow | /rrzk/systeme/sun/ | - |
Disallow | /rrzk/systeme/archiv | - |
Disallow | /rrzk/systeme/linux/infos/howto | - |
Disallow | /rrzk/server/sundoku/ | - |
Disallow | /rrzk/software/dtp/tex/lokal/doc | - |
Disallow | /rrzk/software/tv/tex/lokal/doc | - |
Disallow | /rrzk/software/textverarbeitung/tex/lokal/doc | - |
Disallow | /multimedia-tag/ | - |
Disallow | /allgemeines/veranstaltungen/multimedia-tag/ | - |
Disallow | /dienste/stat/mon/ | - |
Disallow | /wiso-fak/wisostatsem/skripte | 1.6.04 fuer Christoph Scheicher |
Disallow | /wiso-fak/wisostatsem/hauptstudium | scheicher@statistik.uni-koeln.de |
Disallow | /wiso-fak/wisostatsem/grundstudium | - |
Disallow | /ew-fak/Paeda | 16.6. fuer Matthias Kleinow |
Disallow | /ew-fak/Allg_paeda | kleinow@t-online.de |
Comments