cdlib.org
robots.txt
Robots Exclusion Standard data for cdlib.org
Resource Scan
Scan Details
| Site Domain | cdlib.org |
| Base Domain | cdlib.org |
| Scan Status | Ok |
| Last Scan | 2024-05-21T14:54:43+00:00 |
| Next Scan | 2024-06-20T14:54:43+00:00 |
Last Scan
| Scanned | 2024-05-21T14:54:43+00:00 |
| URL | https://cdlib.org/robots.txt |
| Domain IPs | 13.226.228.120, 13.226.228.7, 13.226.228.8, 13.226.228.80 |
| Response IP | 108.157.60.108 |
| Found | Yes |
| Hash | 8cd9b6f375fec898cfcc110eaa38ea584dd8963929e5e1036b2ed393a849f58b |
| SimHash | cc08c884eb93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /apps/cdlib/htdocs/services/d2d/request/stats |
| Disallow | /apps/cdlib/htdocs/services/d2d/ucelinks/stats |