clas.ufl.edu
robots.txt

Robots Exclusion Standard data for clas.ufl.edu

Resource Scan

Scan Details

Site Domain clas.ufl.edu
Base Domain ufl.edu
Scan Status Ok
Last Scan2025-10-08T14:27:02+00:00
Next Scan 2025-11-07T14:27:02+00:00

Last Scan

Scanned2025-10-08T14:27:02+00:00
URL https://clas.ufl.edu/robots.txt
Domain IPs 128.227.24.125
Response IP 128.227.24.125
Found Yes
Hash b9fa036ecce3c7b602d09b14fc82b82989e57ede71bb1639b41010db5d08266c
SimHash ec21d868e392

Groups

*

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 2

gptbot

Rule Path
Disallow /events/

Other Records

Field Value
crawl-delay 5