ustlib.ust.edu.ph
robots.txt
Robots Exclusion Standard data for ustlib.ust.edu.ph
Resource Scan
Scan Details
| Site Domain | ustlib.ust.edu.ph |
| Base Domain | ust.edu.ph |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Request timed out. |
| Last Scan | 2025-10-15T08:05:36+00:00 |
| Next Scan | 2025-12-14T08:05:36+00:00 |
Last Successful Scan
| Scanned | 2025-07-24T07:36:07+00:00 |
| URL | http://ustlib.ust.edu.ph/robots.txt |
| Domain IPs | 202.65.183.201 |
| Response IP | 202.65.183.201 |
| Found | Yes |
| Hash | 39b438db753cd98691685cc131cf488a251610b2a04c915699442bdf8a20d76b |
| SimHash | 27f6fd667cb6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /acquire |
| Disallow | /airpac |
| Disallow | /airwkst |
| Disallow | /articles |
| Disallow | /availlim |
| Disallow | /bookill |
| Disallow | /bookit |
| Disallow | /circhistlim |
| Disallow | /circpix |
| Disallow | /cisti_order |
| Disallow | /clearhist |
| Disallow | /documents |
| Disallow | /donate |
| Disallow | /extlang |
| Disallow | /feeds |
| Disallow | /ftlist |
| Disallow | /goto |
| Disallow | /iii |
| Disallow | /ill |
| Disallow | /illframe |
| Disallow | /indexsort |
| Disallow | /journill |
| Disallow | /kids |
| Disallow | /launch |
| Disallow | /logout |
| Disallow | /manage |
| Disallow | /manual |
| Disallow | /metafind |
| Disallow | /mfgo |
| Disallow | /netli |
| Disallow | /nonret |
| Disallow | /patroninfo |
| Disallow | /programs |
| Disallow | /record%3D |
| Disallow | /review |
| Disallow | /screens |
| Disallow | /search |
| Disallow | /selfreg |
| Disallow | /setlang |
| Disallow | /setscope |
| Disallow | /suggest |
| Disallow | /tmp |
| Disallow | /validate |
| Disallow | /VERIFYPATRON |
| Disallow | /VERSION |
| Disallow | /weblang |
| Disallow | /wm |
| Disallow | /xrecord%3D |
| Disallow | /z39 |
| Disallow | /z39m |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot-ia
| Rule | Path |
|---|---|
| Disallow | /acquire |
| Disallow | /airpac |
| Disallow | /airwkst |
| Disallow | /articles |
| Disallow | /availlim |
| Disallow | /bookill |
| Disallow | /bookit |
| Disallow | /circhistlim |
| Disallow | /circpix |
| Disallow | /cisti_order |
| Disallow | /clearhist |
| Disallow | /documents |
| Disallow | /donate |
| Disallow | /extlang |
| Disallow | /feeds |
| Disallow | /ftlist |
| Disallow | /goto |
| Disallow | /iii |
| Disallow | /ill |
| Disallow | /illframe |
| Disallow | /indexsort |
| Disallow | /journill |
| Disallow | /kids |
| Disallow | /launch |
| Disallow | /logout |
| Disallow | /manage |
| Disallow | /manual |
| Disallow | /metafind |
| Disallow | /mfgo |
| Disallow | /netli |
| Disallow | /nonret |
| Disallow | /patroninfo |
| Disallow | /programs |
| Disallow | /record%3D |
| Disallow | /review |
| Disallow | /search |
| Disallow | /selfreg |
| Disallow | /setlang |
| Disallow | /setscope |
| Disallow | /suggest |
| Disallow | /tmp |
| Disallow | /validate |
| Disallow | /VERIFYPATRON |
| Disallow | /VERSION |
| Disallow | /weblang |
| Disallow | /wm |
| Disallow | /xrecord%3D |
| Disallow | /z39 |
| Disallow | /z39m |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments