mwsu.edu
robots.txt
Robots Exclusion Standard data for mwsu.edu
Resource Scan
Scan Details
| Site Domain | mwsu.edu |
| Base Domain | mwsu.edu |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-08-12T13:05:30+00:00 |
| Next Scan | 2024-11-10T13:05:30+00:00 |
Last Successful Scan
| Scanned | 2023-03-29T06:43:17+00:00 |
| URL | http://mwsu.edu/robots.txt |
| Redirect | https://msutexas.edu/robots.txt |
| Redirect Domain | msutexas.edu |
| Redirect Base | msutexas.edu |
| Domain IPs | 97.77.46.57 |
| Redirect IPs | 97.77.46.57 |
| Response IP | 97.77.46.57 |
| Found | Yes |
| Hash | a619f9e83c99c0f7b2ff11beb586bf3c1307a15a13603a4a718603c5ea3b45ae |
| SimHash | c96c5ca62b03 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /web_resources/ |
| Disallow | /it/banner/index |
| Disallow | /it/banner/index2 |
| Disallow | /academics/hs2/healthandpublic/MHA |
| Disallow | /registrar/apply-graduation/apply-forms.php |
| Disallow | /registrar/apply-graduation/applyformsg.php |
| Disallow | /urlredirects.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://msutexas.edu/sitemap-index.xml |