online.colostate.edu
robots.txt

Robots Exclusion Standard data for online.colostate.edu

Resource Scan

Scan Details

Site Domain online.colostate.edu
Base Domain colostate.edu
Scan Status Ok
Last Scan2025-05-06T05:32:56+00:00
Next Scan 2025-06-05T05:32:56+00:00

Last Scan

Scanned2025-05-06T05:32:56+00:00
URL https://online.colostate.edu/robots.txt
Domain IPs 129.82.148.201
Response IP 129.82.148.201
Found Yes
Hash 0cdc5064e6002c24e0cc0afa01b0e2e55e24ca517d5856bda767a4ac49297690
SimHash cd0c584d8593

Groups

*

Rule Path
Disallow /c/
Disallow /html/common/
Disallow /courses/EDUC/EDUC591A.dot?*
Disallow /global/docs/syllabi/GES520_Fall2020.pdf
Disallow /search/

Other Records

Field Value
sitemap https://www.online.colostate.edu/global/sitemap.xml