ut.edu
robots.txt
Robots Exclusion Standard data for ut.edu
Resource Scan
Scan Details
| Site Domain | ut.edu |
| Base Domain | ut.edu |
| Scan Status | Ok |
| Last Scan | 2024-10-31T11:11:53+00:00 |
| Next Scan | 2024-11-30T11:11:53+00:00 |
Last Scan
| Scanned | 2024-10-31T11:11:53+00:00 |
| URL | https://ut.edu/robots.txt |
| Redirect | https://www.ut.edu/robots.txt |
| Redirect Domain | www.ut.edu |
| Redirect Base | ut.edu |
| Domain IPs | 151.101.131.10, 151.101.195.10, 151.101.3.10, 151.101.67.10 |
| Redirect IPs | 151.101.131.10, 151.101.195.10, 151.101.3.10, 151.101.67.10 |
| Response IP | 151.101.131.10 |
| Found | Yes |
| Hash | 2746b69ee33673ea42ce5260cb0ed8be05d48a33c95d131886a2bfb1241e00da |
| SimHash | c91d8a70ce12 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /spartannet/spartannet-for-students/ |
| Disallow | /spartannet/spartannet-for-faculty/ |
| Disallow | /spartannet/spartannet-for-staff/ |
| Disallow | /directory/keys-shajobia |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ut.edu/sitemap.xml |