catalog.colorado.edu
robots.txt

Robots Exclusion Standard data for catalog.colorado.edu

Resource Scan

Scan Details

Site Domain catalog.colorado.edu
Base Domain colorado.edu
Scan Status Ok
Last Scan2025-03-03T18:33:55+00:00
Next Scan 2025-04-02T18:33:55+00:00

Last Scan

Scanned2025-03-03T18:33:55+00:00
URL https://catalog.colorado.edu/robots.txt
Domain IPs 12.175.6.47
Response IP 12.175.6.47
Found Yes
Hash 939fb55264a0e91b5e1490b565ed49f12ed6ea859b3079709a7d480be06ae01a
SimHash 880d7ce5b189

Groups

*

Rule Path
Disallow /archive/
Disallow /admin/
Disallow /azindex/
Disallow /catalogcontents/
Disallow /cim/
Disallow /clmail/
Disallow /courseadmin/
Disallow /courseleaf/
Disallow /css/
Disallow /dbleaf/
Disallow /depts/
Disallow /fonts/
Disallow /gallery/
Disallow /images/
Disallow /intentstage/
Disallow /js/
Disallow /microcredentialadmin/
Disallow /mig/
Disallow /migration/
Disallow /miscadmin/
Disallow /navbar/
Disallow /pagewiz/
Disallow /programadmin/
Disallow /responseform/
Disallow /ribbit/
Disallow /search/
Disallow /shared/
Disallow /styles/
Disallow /tmp/
Disallow /wiztest/
Disallow /wen/
Disallow /xsearch/

Other Records

Field Value
sitemap https://catalog.colorado.edu/sitemap.xml