zs.thulb.uni-jena.de
robots.txt
Robots Exclusion Standard data for zs.thulb.uni-jena.de
Resource Scan
Scan Details
Site Domain | zs.thulb.uni-jena.de |
Base Domain | uni-jena.de |
Scan Status | Ok |
Last Scan | 2025-07-14T05:02:15+00:00 |
Next Scan | 2025-08-13T05:02:15+00:00 |
Last Scan
Scanned | 2025-07-14T05:02:15+00:00 |
URL | https://zs.thulb.uni-jena.de/robots.txt |
Domain IPs | 141.35.110.200, 141.35.111.200, 2001:638:1558:236e::c8, 2001:638:1558:236f::c8 |
Response IP | 141.35.110.200 |
Found | Yes |
Hash | ed770faf56fa2a6f297285d6a72c61d3e260a64b17fb5d2cc1db239a4c75e768 |
SimHash | 4d10dc14f752 |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /servlets/ |
Disallow | /browse/ |
Disallow | /rsc/ |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |