uni-bielefeld.de
robots.txt
Robots Exclusion Standard data for uni-bielefeld.de
Resource Scan
Scan Details
| Site Domain | uni-bielefeld.de |
| Base Domain | uni-bielefeld.de |
| Scan Status | Ok |
| Last Scan | 2024-11-19T03:57:28+00:00 |
| Next Scan | 2024-12-19T03:57:28+00:00 |
Last Scan
| Scanned | 2024-11-19T03:57:28+00:00 |
| URL | https://uni-bielefeld.de/robots.txt |
| Redirect | https://www.uni-bielefeld.de/robots.txt |
| Redirect Domain | www.uni-bielefeld.de |
| Redirect Base | uni-bielefeld.de |
| Domain IPs | 129.70.240.4 |
| Redirect IPs | 129.70.240.4 |
| Response IP | 129.70.240.4 |
| Found | Yes |
| Hash | e74f7212b07d7626c6f81f4e6291f597e4ef073e03d80f47d9d00e757387d937 |
| SimHash | 24236913f972 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/cgi/ |
| Disallow | /edit/ |
| Disallow | /schulung/* |
| Disallow | /themen/testseite/* |
| Disallow | /ub/_intern/* |
| Disallow | /uni/einrichtungen-organisation/rektorat/rektoratsmitglieder/* |
| Disallow | /_internal/ |
| Disallow | /cgi-bin/ |
| Disallow | /Universitaet/* |
| Disallow | /%28de%29/* |
| Disallow | /%28en%29/* |
| Disallow | /%3C-en%2Cde%3E/* |
| Disallow | /%3Cen%3E/* |
| Disallow | /%3Cde%3E/* |
| Disallow | /%3C-en%3E/* |
| Disallow | /%3C-de%3E/* |
Warnings
- 1 invalid line.