blogs.ifas.ufl.edu
robots.txt
Robots Exclusion Standard data for blogs.ifas.ufl.edu
Resource Scan
Scan Details
| Site Domain | blogs.ifas.ufl.edu |
| Base Domain | ufl.edu |
| Scan Status | Ok |
| Last Scan | 2025-08-19T16:57:28+00:00 |
| Next Scan | 2025-09-18T16:57:28+00:00 |
Last Scan
| Scanned | 2025-08-19T16:57:28+00:00 |
| URL | https://blogs.ifas.ufl.edu/robots.txt |
| Domain IPs | 128.227.68.230 |
| Response IP | 128.227.68.230 |
| Found | Yes |
| Hash | 56094902005f8f587caaa66d063a31abcf49e8abf499ec35b08a6c0ee204c661 |
| SimHash | e4a0d34047d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/wp-json |
| Disallow | /*/feedname$ |
| Disallow | /*/feed$ |
| Disallow | /error404 |
| Disallow | /*/tag |
| Disallow | /*/page/* |
| Allow | /* |
| Allow | /*/events/ |
| Allow | /*/events/* |
| Allow | /global |
| Allow | /global/ |
| Allow | /global/category/agriculture/ |
| Allow | /global/category/natural-resources/ |
| Allow | /global/category/home-landscapes/ |
| Allow | /global/category/work-and-life/ |
| Allow | /global/category/4-h-and-youth/ |
| Allow | /global/author/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 6 |