csus.edu
robots.txt
Robots Exclusion Standard data for csus.edu
Resource Scan
Scan Details
| Site Domain | csus.edu |
| Base Domain | csus.edu |
| Scan Status | Ok |
| Last Scan | 2024-09-05T22:02:01+00:00 |
| Next Scan | 2024-10-05T22:02:01+00:00 |
Last Scan
| Scanned | 2024-09-05T22:02:01+00:00 |
| URL | https://csus.edu/robots.txt |
| Redirect | https://www.csus.edu/robots.txt |
| Redirect Domain | www.csus.edu |
| Redirect Base | csus.edu |
| Domain IPs | 130.86.9.189 |
| Redirect IPs | 130.86.9.189 |
| Response IP | 130.86.9.189 |
| Found | Yes |
| Hash | 94e60222af9cee2a99b763bd041c9ef08a985aaaf315ed33507ae0118f9b5a84 |
| SimHash | aa3cd2fae912 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /archive/ |
| Disallow | /archives/ |
| Disallow | /cached/ |
| Disallow | /dev/ |
| Disallow | /irt/dev2/ |
| Disallow | /irt/old/ |
| Disallow | /search/ |
| Disallow | /atc/archived/ |
| Disallow | /oldcatalog/ |
| Disallow | /irt/ |
| Disallow | /aba/ |
| Disallow | /cec/ |
| Disallow | /ssis/ |
| Disallow | /cba/ |
| Disallow | /nsm/ |
| Disallow | /hhs/ |
| Disallow | /coe/ |
| Disallow | /acaf/ |
| Disallow | /acad/ |
| Disallow | /hr/ |