uwf.edu
robots.txt
Robots Exclusion Standard data for uwf.edu
Resource Scan
Scan Details
| Site Domain | uwf.edu |
| Base Domain | uwf.edu |
| Scan Status | Ok |
| Last Scan | 2024-10-29T08:21:58+00:00 |
| Next Scan | 2024-11-28T08:21:58+00:00 |
Last Scan
| Scanned | 2024-10-29T08:21:58+00:00 |
| URL | https://uwf.edu/robots.txt |
| Domain IPs | 143.88.3.75 |
| Response IP | 143.88.3.75 |
| Found | Yes |
| Hash | 7e001b64c68eb7bf34ddcc96ac3f4c2184b83070524bd956f4601d23f6d0a46c |
| SimHash | 9255fc3c3581 |
Groups
*
dubbotbot/0.2
| Rule | Path |
|---|---|
| Disallow | /t4dev/ |
| Disallow | /t4test/ |
| Disallow | /uwfbanner/bookshelf |
| Disallow | /uwfMain/calendar |
| Disallow | /atc/calendar |
| Disallow | /intered/calendar |
| Disallow | /honors/forum/ |
| Disallow | /catalog/cat2010/ |
| Disallow | /catalog/cat2009/ |
| Disallow | /catalog/cat2008/ |
| Disallow | /catalog/cat2007/ |
| Disallow | /catalog/cat2006/ |
| Disallow | /catalog/cat2005/ |
| Disallow | /catalog/cat2004/ |
| Disallow | /catalog/cat2003/ |
| Disallow | /catalog/cat2002/ |
| Disallow | /catalog/cat2001/ |
| Disallow | /catalog/cat2000/ |
| Disallow | /catalog/cat1999/ |
| Disallow | /catalog/cat1998/ |
| Disallow | /catalog/cat1997/ |
| Disallow | /catalog/cat1996/ |
| Disallow | /catalog/catalog_95-96 |
| Disallow | /*/dev/ |
| Disallow | /*/dev2/ |
| Disallow | /*/dev3/ |
| Disallow | /*/dev4/ |
| Disallow | /*/dev5/ |
| Disallow | /*/dev6/ |
| Disallow | /*/dev7/ |
| Disallow | /*/dev8/ |
| Disallow | /*/dev9/ |
| Disallow | /*/recycle/ |
| Disallow | /graduate/online-orientation/* |
| Disallow | /admissions/undergraduate/cost-and-financial-aid/awards-and-scholarships/presidents-scholarship-competition/ |
| Disallow | /university-advancement/departments/development/donor-recognition/northwest-florida-heart-challenge-2022/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments