msutexas.edu
robots.txt
Robots Exclusion Standard data for msutexas.edu
Resource Scan
Scan Details
| Site Domain | msutexas.edu |
| Base Domain | msutexas.edu |
| Scan Status | Ok |
| Last Scan | 2024-09-17T02:21:55+00:00 |
| Next Scan | 2024-10-17T02:21:55+00:00 |
Last Scan
| Scanned | 2024-09-17T02:21:55+00:00 |
| URL | https://msutexas.edu/robots.txt |
| Domain IPs | 97.77.46.57 |
| Response IP | 97.77.46.57 |
| Found | Yes |
| Hash | a619f9e83c99c0f7b2ff11beb586bf3c1307a15a13603a4a718603c5ea3b45ae |
| SimHash | c96c5ca62b03 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /web_resources/ |
| Disallow | /it/banner/index |
| Disallow | /it/banner/index2 |
| Disallow | /academics/hs2/healthandpublic/MHA |
| Disallow | /registrar/apply-graduation/apply-forms.php |
| Disallow | /registrar/apply-graduation/applyformsg.php |
| Disallow | /urlredirects.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://msutexas.edu/sitemap-index.xml |