unb.ca
robots.txt
Robots Exclusion Standard data for unb.ca
Resource Scan
Scan Details
| Site Domain | unb.ca |
| Base Domain | unb.ca |
| Scan Status | Ok |
| Last Scan | 2025-08-05T02:53:49+00:00 |
| Next Scan | 2025-09-04T02:53:49+00:00 |
Last Scan
| Scanned | 2025-08-05T02:53:49+00:00 |
| URL | https://unb.ca/robots.txt |
| Domain IPs | 131.202.255.201 |
| Response IP | 131.202.255.201 |
| Found | Yes |
| Hash | 599f2324d5906b4d056a9d40b812d5601bfaa4e0a1560ab0d0f7653414af96af |
| SimHash | 69541456d3b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /xml/ |
| Disallow | /academics/calendar/undergraduate/2014/ |
| Disallow | /anthropology/ |
| Disallow | /archive/ |
| Disallow | /AVS/ |
| Disallow | /bible/ |
| Disallow | /bruns/ |
| Disallow | /cel/disney |
| Disallow | /cel/exed/disney-institute |
| Disallow | /chsr/ |
| Disallow | /econ/ |
| Disallow | /extenddev/ |
| Disallow | /FineArts/ |
| Disallow | /fredericton/kinesiology/newsletter/ |
| Disallow | /fredericton/business/international/singapore |
| Disallow | /futurestudents/sj-tour-feedback-form.html |
| Disallow | /linux/ |
| Disallow | /lms/ |
| Disallow | /naweb/ |
| Disallow | /nre/ |
| Disallow | /news/ |
| Disallow | /president/agenda/ |
| Disallow | /postings/ |
| Disallow | /saintjohn/sase/grad/biology/_resources/proposals |
| Disallow | /standint/ |
| Disallow | /webteam/ |
| Disallow | /webdev/ |
| Disallow | /admissions/future-students.html |
| Disallow | /admissions/request-information-received.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.unb.ca/sitemap.xml |