repository.ugm.ac.id
robots.txt
Robots Exclusion Standard data for repository.ugm.ac.id
Resource Scan
Scan Details
Site Domain | repository.ugm.ac.id |
Base Domain | ugm.ac.id |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-04T05:11:24+00:00 |
Next Scan | 2024-09-02T05:11:24+00:00 |
Last Successful Scan
Scanned | 2023-07-18T03:37:54+00:00 |
URL | https://repository.ugm.ac.id/robots.txt |
Domain IPs | 175.111.88.112 |
Response IP | 175.111.88.112 |
Found | Yes |
Hash | 5ac4af56b35ca81b1bbe1ccafaf1d84f0f79ad12dbda52ff95871005969e4e23 |
SimHash | 28109d014575 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 600 |
Other Records
Field | Value |
---|---|
sitemap | https://repository.ugm.ac.id/sitemap.xml |
Comments