uni-bielefeld.de
robots.txt
Robots Exclusion Standard data for uni-bielefeld.de
Resource Scan
Scan Details
| Site Domain | uni-bielefeld.de |
| Base Domain | uni-bielefeld.de |
| Scan Status | Ok |
| Last Scan | 2024-06-21T22:00:57+00:00 |
| Next Scan | 2024-07-21T22:00:57+00:00 |
Last Scan
| Scanned | 2024-06-21T22:00:57+00:00 |
| URL | https://uni-bielefeld.de/robots.txt |
| Redirect | https://www.uni-bielefeld.de/robots.txt |
| Redirect Domain | www.uni-bielefeld.de |
| Redirect Base | uni-bielefeld.de |
| Domain IPs | 129.70.240.4 |
| Redirect IPs | 129.70.240.4 |
| Response IP | 129.70.240.4 |
| Found | Yes |
| Hash | 7677270cd5b1a087d136118e90a377116ddee5042231ce42fc33f196a3b84c9c |
| SimHash | a7236bd3f972 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/cgi/ |
| Disallow | /edit/ |
| Disallow | /schulung/* |
| Disallow | /themen/testseite/* |
| Disallow | /ub/_intern/* |
| Disallow | /uni/einrichtungen-organisation/rektorat/rektoratsmitglieder/* |
| Disallow | /_internal/ |
| Disallow | /cgi-bin/ |
| Disallow | /Universitaet/* |
| Disallow | /%28de%29/* |
| Disallow | /%28en%29/* |
| Disallow | /%3C-en%2Cde%3E/* |
| Disallow | /%3Cen%3E/* |
| Disallow | /%3Cde%3E/* |
| Disallow | /%3C-en%3E/* |
| Disallow | /%3C-de%3E/* |
Warnings
- 1 invalid line.