siue.edu
robots.txt

Robots Exclusion Standard data for siue.edu

Resource Scan

Scan Details

Site Domain siue.edu
Base Domain siue.edu
Scan Status Ok
Last Scan2025-10-26T18:51:37+00:00
Next Scan 2025-11-25T18:51:37+00:00

Last Scan

Scanned2025-10-26T18:51:37+00:00
URL https://siue.edu/robots.txt
Redirect https://www.siue.edu/robots.txt
Redirect Domain www.siue.edu
Redirect Base siue.edu
Domain IPs 146.163.252.208
Redirect IPs 146.163.252.208
Response IP 146.163.252.208
Found Yes
Hash c26e708ebe5188ec0adc9bc1ce0261d9e5a3ac3439bdeba510f801ead4526677
SimHash e8455a918bd7

Groups

*

Rule Path
Disallow /ug-catalog-content-2023-2024
Disallow /meridian-application/
Disallow /ug-catalog-content-2022-2023
Disallow /_archives/
Disallow /_global/
Disallow /_dev/
Disallow /_dev-complete/
Disallow /_dev-new/
Disallow /_dev-old/
Disallow /_archives-publish/
Disallow /_rwd/
Disallow /_*
Disallow /its/sandbox/
Disallow /marketing-and-communications/services/web/email-request.shtml

Other Records

Field Value
sitemap https://www.siue.edu/sitemap-index.xml