zs.thulb.uni-jena.de
robots.txt

Robots Exclusion Standard data for zs.thulb.uni-jena.de

Resource Scan

Scan Details

Site Domain zs.thulb.uni-jena.de
Base Domain uni-jena.de
Scan Status Ok
Last Scan2025-07-14T05:02:15+00:00
Next Scan 2025-08-13T05:02:15+00:00

Last Scan

Scanned2025-07-14T05:02:15+00:00
URL https://zs.thulb.uni-jena.de/robots.txt
Domain IPs 141.35.110.200, 141.35.111.200, 2001:638:1558:236e::c8, 2001:638:1558:236f::c8
Response IP 141.35.110.200
Found Yes
Hash ed770faf56fa2a6f297285d6a72c61d3e260a64b17fb5d2cc1db239a4c75e768
SimHash 4d10dc14f752

Groups

*

Rule Path
Disallow /*?
Disallow /servlets/
Disallow /browse/
Disallow /rsc/
Disallow /api/

Other Records

Field Value
crawl-delay 10