catalog.ufl.edu
robots.txt

Robots Exclusion Standard data for catalog.ufl.edu

Resource Scan

Scan Details

Site Domain catalog.ufl.edu
Base Domain ufl.edu
Scan Status Ok
Last Scan2025-03-03T19:16:39+00:00
Next Scan 2025-04-02T19:16:39+00:00

Last Scan

Scanned2025-03-03T19:16:39+00:00
URL https://catalog.ufl.edu/robots.txt
Domain IPs 12.175.6.47
Response IP 12.175.6.47
Found Yes
Hash b719bdbecdbb36f5679081bfbc6ef7d77421563d24ebfd5f6a39ceb2ab43c97c
SimHash 8d197c65b19f

Groups

*

Rule Path
Disallow /UGRD/previous-catalogs/
Disallow /admin/
Disallow /azindex/
Disallow /catalogcontents/
Disallow /cim/
Disallow /courseadmin/
Disallow /courseleaf/
Disallow /css/
Disallow /dbleaf/
Disallow /depts/
Disallow /fonts/
Disallow /gallery/
Disallow /images/
Disallow /js/
Disallow /mig/
Disallow /migration/
Disallow /navbar/
Disallow /programadmin/
Disallow /responseform/
Disallow /ribbit/
Disallow /sam/
Disallow /search/
Disallow /shared/
Disallow /styles/
Disallow /tmp/
Disallow /wiztest/
Disallow /course-search/api/

Other Records

Field Value
sitemap http://catalog.ufl.edu/sitemap.xml