dlmp.uw.edu
robots.txt
Robots Exclusion Standard data for dlmp.uw.edu
Resource Scan
Scan Details
| Site Domain | dlmp.uw.edu |
| Base Domain | uw.edu |
| Scan Status | Ok |
| Last Scan | 2025-09-14T16:14:44+00:00 |
| Next Scan | 2025-10-14T16:14:44+00:00 |
Last Scan
| Scanned | 2025-09-14T16:14:44+00:00 |
| URL | https://dlmp.uw.edu/robots.txt |
| Domain IPs | 128.95.186.23 |
| Response IP | 128.95.186.23 |
| Found | Yes |
| Hash | 5dd2284490e979617e07e422e45c4e71291ff7e85f7de0df9374d93d7ce070cd |
| SimHash | 0812f9eac935 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /stats/ |
| Disallow | /toremove/ |
| Disallow | /tech/ |
| Disallow | /academics/classes/ |
| Disallow | /test/ |
| Disallow | /train/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Comments