Log In Sign Up

cs.colostate.edu
robots.txt

Robots Exclusion Standard data for cs.colostate.edu

Resource Scan

Scan Details

Site Domain cs.colostate.edu
Base Domain colostate.edu
Scan Status Ok
Last Scan2025-05-25T15:09:39+00:00
Next Scan 2025-06-24T15:09:39+00:00

Last Scan

Scanned2025-05-25T15:09:39+00:00
URL https://cs.colostate.edu/robots.txt
Domain IPs 129.82.45.48
Response IP 129.82.45.48
Found Yes
Hash f2776ebbcfcb9a2e78052c76f3954d834863099080eff0ac9f81194f1fcdf27d
SimHash 19861e844672

Groups

httrack

Rule Path
Disallow /
Back to top

Comments

  • robots.txt file for Colorado State University CS Department
  • Tells robot search engines (Lycos, Web Crawler, etc.) what they cannot access
Back to top

Warnings

  • 1 invalid line.
  • `` is not a known field.
Back to top