uni-koeln.de
robots.txt
Robots Exclusion Standard data for uni-koeln.de
Resource Scan
Scan Details
| Site Domain | uni-koeln.de |
| Base Domain | uni-koeln.de |
| Scan Status | Ok |
| Last Scan | 2024-06-03T16:45:38+00:00 |
| Next Scan | 2024-06-17T16:45:38+00:00 |
Last Scan
| Scanned | 2024-06-03T16:45:38+00:00 |
| URL | https://uni-koeln.de/robots.txt |
| Domain IPs | 134.95.81.52, 2a00:a200:0:2::80 |
| Response IP | 134.95.81.52 |
| Found | Yes |
| Hash | 80d25a7b01b77b9837952823525846470b7ee30c7dc4247333e05ca998dbbf6f |
| SimHash | a865ab02a7c0 |
Groups
*
| Product | Comment |
|---|---|
| * | All other spiders should avoid |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin/ | Script files |
| Disallow | /bin2/ | Script files |
| Disallow | /bin3/ | Script files |
| Disallow | /kurs-bin/ | Script files |
| Disallow | /htdig/ | Script files |
| Disallow | /admin/ | - |
| Disallow | /experimente/ | - |
| Disallow | /intern/ | - |
| Disallow | /extern/ | - |
| Disallow | /kiosk/ | - |
| Disallow | /rrzk/org/mitarbeiter/ | - |
| Disallow | /wiso-fak/szyperski/intern/ | - |
| Disallow | /phil-fak/phil/org/aktuell.htm | - |
| Disallow | /med-fak/auge/mitarbeiter.html | - |
| Disallow | /rrzk/software/fachspezifisch/Biologie-Genetik/wispact/ | - |
| Disallow | /rrzk/Abt-Systeme/ | - |
| Disallow | /rrzk/systeme/SFgate/ | - |
| Disallow | /rrzk/systeme/WWW/ | - |
| Disallow | /rrzk/systeme/cgi-bin/ | - |
| Disallow | /rrzk/systeme/dec/ | - |
| Disallow | /rrzk/systeme/hp/ | - |
| Disallow | /rrzk/systeme/htbin/ | - |
| Disallow | /rrzk/systeme/ibm/ | - |
| Disallow | /rrzk/systeme/intern/ | - |
| Disallow | /rrzk/systeme/microsoft/ | - |
| Disallow | /rrzk/systeme/nt/ | - |
| Disallow | /rrzk/systeme/os2/ | - |
| Disallow | /rrzk/systeme/sgi/ | - |
| Disallow | /rrzk/systeme/sun/ | - |
| Disallow | /rrzk/systeme/archiv | - |
| Disallow | /rrzk/systeme/linux/infos/howto | - |
| Disallow | /rrzk/server/sundoku/ | - |
| Disallow | /rrzk/software/dtp/tex/lokal/doc | - |
| Disallow | /rrzk/software/tv/tex/lokal/doc | - |
| Disallow | /rrzk/software/textverarbeitung/tex/lokal/doc | - |
| Disallow | /multimedia-tag/ | - |
| Disallow | /allgemeines/veranstaltungen/multimedia-tag/ | - |
| Disallow | /dienste/stat/mon/ | - |
| Disallow | /wiso-fak/wisostatsem/skripte | 1.6.04 fuer Christoph Scheicher |
| Disallow | /wiso-fak/wisostatsem/hauptstudium | scheicher@statistik.uni-koeln.de |
| Disallow | /wiso-fak/wisostatsem/grundstudium | - |
| Disallow | /ew-fak/Paeda | 16.6. fuer Matthias Kleinow |
| Disallow | /ew-fak/Allg_paeda | kleinow@t-online.de |
Comments