lib.unnes.ac.id
robots.txt

Robots Exclusion Standard data for lib.unnes.ac.id

Resource Scan

Scan Details

Site Domain lib.unnes.ac.id
Base Domain unnes.ac.id
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-11T02:18:34+00:00
Next Scan 2025-07-10T02:18:34+00:00

Last Successful Scan

Scanned2024-08-22T01:47:35+00:00
URL https://lib.unnes.ac.id/robots.txt
Domain IPs 104.26.4.12, 104.26.5.12, 172.67.71.22, 2606:4700:20::681a:40c, 2606:4700:20::681a:50c, 2606:4700:20::ac43:4716
Response IP 104.26.5.12
Found Yes
Hash 4f8dcc2f6983ef4d12e8c593c1ff70667ec78c8dce7d9b8efc112538741499de
SimHash 2945d041ed93

Groups

*

Rule Path
Disallow /cgi/

Other Records

Field Value
sitemap http://lib.unnes.ac.id/sitemap.xml