ub.uni-bielefeld.de
robots.txt
Robots Exclusion Standard data for ub.uni-bielefeld.de
Resource Scan
Scan Details
| Site Domain | ub.uni-bielefeld.de |
| Base Domain | uni-bielefeld.de |
| Scan Status | Ok |
| Last Scan | 2024-05-24T09:09:27+00:00 |
| Next Scan | 2024-06-23T09:09:27+00:00 |
Last Scan
| Scanned | 2024-05-24T09:09:27+00:00 |
| URL | https://ub.uni-bielefeld.de/robots.txt |
| Domain IPs | 129.70.12.38 |
| Response IP | 129.70.12.38 |
| Found | Yes |
| Hash | 9865a2c8d43df354bb75f74a6a84a777603542f2369698bb0fbd1597436d2ef8 |
| SimHash | 1912f9296fa2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /~befehl/ |
| Disallow | /~brsadmin/ |
| Disallow | /~cbroschinski/ |
| Disallow | /~cpietcsh/ |
| Disallow | /~prax/ |
| Disallow | /~whorstmann/ |
| Disallow | /advhilfe/ |
| Disallow | /biblio/fotos/ |
| Disallow | /captcha/ |
| Disallow | /cgi-bin/ |
| Disallow | /css/ |
| Disallow | /ct/ |
| Disallow | /diglib/seiler/ |
| Disallow | /div/db/ |
| Disallow | /div/display/ |
| Disallow | /div/download/ |
| Disallow | /div/flash/ |
| Disallow | /div/tools/ |
| Disallow | /div/zertifikat/ |
| Disallow | /fonts/ |
| Disallow | /graphics/fotos/ |
| Disallow | /help/chat/log/ |
| Disallow | /help/tutorial/freigabephp/ |
| Disallow | /images/ |
| Disallow | /ix/ |
| Disallow | /jasocgi/ |
| Disallow | /javascript/ |
| Disallow | /jquery/ |
| Disallow | /js/ |
| Disallow | /netacgi/ |
| Disallow | /netaicon/ |
| Disallow | /netahtml/ |
| Disallow | /pdf-dbs/ |
| Disallow | /php/ |
| Disallow | /testothek/ |
| Disallow | /unibi-cgi/ |
| Disallow | /wbt/ |
| Disallow | /wiki/ |
| Disallow | /wincenter/ |
Warnings
- 1 invalid line.
Comments