unbf.ca
robots.txt
Robots Exclusion Standard data for unbf.ca
Resource Scan
Scan Details
| Site Domain | unbf.ca |
| Base Domain | unbf.ca |
| Scan Status | Ok |
| Last Scan | 2025-08-28T07:34:18+00:00 |
| Next Scan | 2025-09-27T07:34:18+00:00 |
Last Scan
| Scanned | 2025-08-28T07:34:18+00:00 |
| URL | http://unbf.ca/robots.txt |
| Redirect | https://www.unb.ca/robots.txt |
| Redirect Domain | www.unb.ca |
| Redirect Base | unb.ca |
| Domain IPs | 131.202.255.201 |
| Redirect IPs | 131.202.255.201 |
| Response IP | 131.202.255.201 |
| Found | Yes |
| Hash | 599f2324d5906b4d056a9d40b812d5601bfaa4e0a1560ab0d0f7653414af96af |
| SimHash | 69541456d3b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /xml/ |
| Disallow | /academics/calendar/undergraduate/2014/ |
| Disallow | /anthropology/ |
| Disallow | /archive/ |
| Disallow | /AVS/ |
| Disallow | /bible/ |
| Disallow | /bruns/ |
| Disallow | /cel/disney |
| Disallow | /cel/exed/disney-institute |
| Disallow | /chsr/ |
| Disallow | /econ/ |
| Disallow | /extenddev/ |
| Disallow | /FineArts/ |
| Disallow | /fredericton/kinesiology/newsletter/ |
| Disallow | /fredericton/business/international/singapore |
| Disallow | /futurestudents/sj-tour-feedback-form.html |
| Disallow | /linux/ |
| Disallow | /lms/ |
| Disallow | /naweb/ |
| Disallow | /nre/ |
| Disallow | /news/ |
| Disallow | /president/agenda/ |
| Disallow | /postings/ |
| Disallow | /saintjohn/sase/grad/biology/_resources/proposals |
| Disallow | /standint/ |
| Disallow | /webteam/ |
| Disallow | /webdev/ |
| Disallow | /admissions/future-students.html |
| Disallow | /admissions/request-information-received.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.unb.ca/sitemap.xml |