minerlink.mst.edu
robots.txt

Robots Exclusion Standard data for minerlink.mst.edu

Resource Scan

Scan Details

Site Domain minerlink.mst.edu
Base Domain mst.edu
Scan Status Ok
Last Scan2025-12-04T23:15:29+00:00
Next Scan 2025-12-18T23:15:29+00:00

Last Scan

Scanned2025-12-04T23:15:29+00:00
URL https://minerlink.mst.edu/robots.txt
Domain IPs 100.30.39.209, 2600:1f10:47c2:2400:90eb:f5d7:fca:ac8f, 2600:1f10:47c2:2401:3e13:9406:6585:ef2, 2600:1f10:47c2:2402:3ccf:b37a:3047:5bc1, 54.208.34.229, 98.83.84.239
Response IP 98.83.84.239
Found Yes
Hash 916bf5f925f86fb394a2a96b3f70949da87a4b479cded09e7374f2ca56f4a41a
SimHash b80534e6e383

Groups

*

Rule Path
Disallow /upload/
Disallow /student_docs/
Disallow /downloads/
Disallow /mobile_ws/v17/
Disallow /mobile_ws/v18/
Disallow /*ajax_widget_new