web.ma.utexas.edu
robots.txt
Robots Exclusion Standard data for web.ma.utexas.edu
Resource Scan
Scan Details
| Site Domain | web.ma.utexas.edu |
| Base Domain | utexas.edu |
| Scan Status | Ok |
| Last Scan | 2025-08-26T15:42:42+00:00 |
| Next Scan | 2025-09-25T15:42:42+00:00 |
Last Scan
| Scanned | 2025-08-26T15:42:42+00:00 |
| URL | https://web.ma.utexas.edu/robots.txt |
| Domain IPs | 146.6.139.68 |
| Response IP | 146.6.139.68 |
| Found | Yes |
| Hash | 25844d9aa53668c159b0f9df9026d1fc9ea30d9e54e68b6922f083c1ec499a71 |
| SimHash | 5035ccc6cfd5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/mps |
| Disallow | /cgi-bin/cms/ |
| Disallow | /mp_arc-bin/mpp/ |
| Disallow | /admin/ |
| Disallow | /cgi-pub/ |
| Disallow | /users/radin/stuff/ |
| Disallow | /undergrad/dpfeifer/new/ |
| Disallow | /~tornaria/cnt/ |
| Disallow | /users/tornaria/cnt/ |
| Disallow | /users/neitzke/exports/ |
| Disallow | /wol/ |