unf.edu
robots.txt
Robots Exclusion Standard data for unf.edu
Resource Scan
Scan Details
| Site Domain | unf.edu |
| Base Domain | unf.edu |
| Scan Status | Ok |
| Last Scan | 2024-10-28T05:03:38+00:00 |
| Next Scan | 2024-11-27T05:03:38+00:00 |
Last Scan
| Scanned | 2024-10-28T05:03:38+00:00 |
| URL | https://unf.edu/robots.txt |
| Redirect | https://www.unf.edu/robots.txt |
| Redirect Domain | www.unf.edu |
| Redirect Base | unf.edu |
| Domain IPs | 52.177.54.50 |
| Redirect IPs | 139.62.234.143 |
| Response IP | 139.62.234.143 |
| Found | Yes |
| Hash | f06fd25f4f2b31f4a354ebaccc8346cc32c1d5e38e039d992b2b6cf47000e8f1 |
| SimHash | e90d5c45cf10 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /workarea/ |
| Disallow | /widgets/ |
| Disallow | /catalog/programs/20* |
| Disallow | /catalog-pdf |
| Disallow | /catalog/pdf |
| Disallow | /codecheck/* |
| Disallow | /redesign2.aspx |
| Disallow | /redesign/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.unf.edu/sitemap/sitemap.xml |