catalog.colorado.edu
robots.txt
Robots Exclusion Standard data for catalog.colorado.edu
Resource Scan
Scan Details
Site Domain | catalog.colorado.edu |
Base Domain | colorado.edu |
Scan Status | Ok |
Last Scan | 2025-03-03T18:33:55+00:00 |
Next Scan | 2025-04-02T18:33:55+00:00 |
Last Scan
Scanned | 2025-03-03T18:33:55+00:00 |
URL | https://catalog.colorado.edu/robots.txt |
Domain IPs | 12.175.6.47 |
Response IP | 12.175.6.47 |
Found | Yes |
Hash | 939fb55264a0e91b5e1490b565ed49f12ed6ea859b3079709a7d480be06ae01a |
SimHash | 880d7ce5b189 |
Groups
*
Rule | Path |
---|---|
Disallow | /archive/ |
Disallow | /admin/ |
Disallow | /azindex/ |
Disallow | /catalogcontents/ |
Disallow | /cim/ |
Disallow | /clmail/ |
Disallow | /courseadmin/ |
Disallow | /courseleaf/ |
Disallow | /css/ |
Disallow | /dbleaf/ |
Disallow | /depts/ |
Disallow | /fonts/ |
Disallow | /gallery/ |
Disallow | /images/ |
Disallow | /intentstage/ |
Disallow | /js/ |
Disallow | /microcredentialadmin/ |
Disallow | /mig/ |
Disallow | /migration/ |
Disallow | /miscadmin/ |
Disallow | /navbar/ |
Disallow | /pagewiz/ |
Disallow | /programadmin/ |
Disallow | /responseform/ |
Disallow | /ribbit/ |
Disallow | /search/ |
Disallow | /shared/ |
Disallow | /styles/ |
Disallow | /tmp/ |
Disallow | /wiztest/ |
Disallow | /wen/ |
Disallow | /xsearch/ |
Other Records
Field | Value |
---|---|
sitemap | https://catalog.colorado.edu/sitemap.xml |