www.zedat.fu-berlin.de
robots.txt
Robots Exclusion Standard data for www.zedat.fu-berlin.de
Resource Scan
Scan Details
| Site Domain | www.zedat.fu-berlin.de |
| Base Domain | fu-berlin.de |
| Scan Status | Ok |
| Last Scan | 2024-11-02T18:51:54+00:00 |
| Next Scan | 2024-11-16T18:51:54+00:00 |
Last Scan
| Scanned | 2024-11-02T18:51:54+00:00 |
| URL | https://www.zedat.fu-berlin.de/robots.txt |
| Domain IPs | 130.133.3.7 |
| Response IP | 130.133.3.7 |
| Found | Yes |
| Hash | 15528b8e4c6969a604fd022d789fc4ab7114ac12d1065f820a4815e4d1f33898 |
| SimHash | e7047673ea81 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bin/attach |
| Disallow | /bin/changes |
| Disallow | /bin/compute/ |
| Disallow | /bin/configure |
| Disallow | /bin/edit |
| Disallow | /bin/geturl |
| Disallow | /bin/installpasswd |
| Disallow | /bin/login |
| Disallow | /bin/logon |
| Disallow | /bin/logos |
| Disallow | /bin/mailnotify |
| Disallow | /bin/manage |
| Disallow | /bin/oops |
| Disallow | /bin/passwd |
| Disallow | /bin/preview |
| Disallow | /bin/rdiff |
| Disallow | /bin/rdiffauth |
| Disallow | /bin/register |
| Disallow | /bin/rename |
| Disallow | /bin/resetpasswd |
| Disallow | /bin/rest |
| Disallow | /bin/save |
| Disallow | /bin/savemulti |
| Disallow | /bin/search |
| Disallow | /bin/setlib.cfg |
| Disallow | /bin/statistics |
| Disallow | /bin/testenv |
| Disallow | /bin/upload |
| Disallow | /bin/viewauth |
| Disallow | /bin/viewfile |
| Disallow | /list/ |
| Disallow | /apple/store.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |