www2.umbc.edu
robots.txt
Robots Exclusion Standard data for www2.umbc.edu
Resource Scan
Scan Details
| Site Domain | www2.umbc.edu |
| Base Domain | umbc.edu |
| Scan Status | Ok |
| Last Scan | 2024-11-11T23:49:15+00:00 |
| Next Scan | 2024-12-11T23:49:15+00:00 |
Last Scan
| Scanned | 2024-11-11T23:49:15+00:00 |
| URL | https://www2.umbc.edu/robots.txt |
| Domain IPs | 130.85.12.176 |
| Response IP | 130.85.12.176 |
| Found | Yes |
| Hash | 0a2252b4fd798c0e6094f90a07a697bc19e4582b2e99b52e0e4c83a0ee47efd6 |
| SimHash | 0b3858589f5e |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /blogs | these are very old and should not be searchable in general |
| Disallow | /academics | these are very old and should not be searchable in general |
| Disallow | /aboutumbc | these are very old and should not be searchable in general |
| Disallow | /documents | directory listing |
| Disallow | /emergency_test | test |
| Disallow | /fonts | directory listing |
| Disallow | /givingday | redirect |
| Disallow | /go | redirect |
| Disallow | /graduate | directory listing |
| Disallow | /help | redirect |
| Disallow | /ilsb | redirect |
| Disallow | /images | directory listing |
| Disallow | /img | directory listing |
| Disallow | /images_email | directory listing |
| Disallow | /images_homepage | directory listing |
| Disallow | /images_new | directory listing |
| Disallow | /include | directory listing |
| Disallow | /includes | directory listing |
| Disallow | /innovate | 2012 or so website |
| Disallow | /interns | directory |
| Disallow | /js | directory listing |
| Disallow | /lightcity | redirect |
| Disallow | /magazine | redirect |
| Disallow | /marchmadness | redirect |
| Disallow | /news | redirect |
| Disallow | /orientation | redirect |
| Disallow | /retrievernation | redirect |
| Disallow | /search | redirect |
| Disallow | /stats | forbidden |
| Disallow | /stylesheets | directory |
| Disallow | /summer_interns2013 | these are very old and should not be searchable in general |
| Disallow | /templates | Sites testing? |
| Disallow | /template | New home dev |
| Disallow | /templates | Sites testing? |
| Disallow | /TSA | redirect |
| Disallow | /tsaprequalified | redirect |
| Disallow | /uploads | directory |
| Disallow | /wordsofwisdom | these are very old and should not be searchable in general |
Warnings
- 1 invalid line.