www4.ntu.ac.uk
robots.txt
Robots Exclusion Standard data for www4.ntu.ac.uk
Resource Scan
Scan Details
| Site Domain | www4.ntu.ac.uk |
| Base Domain | ntu.ac.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Request timed out. |
| Last Scan | 2025-09-21T23:55:16+00:00 |
| Next Scan | 2025-11-20T23:55:16+00:00 |
Last Successful Scan
| Scanned | 2025-07-01T21:32:15+00:00 |
| URL | https://www4.ntu.ac.uk/robots.txt |
| Domain IPs | 152.71.0.42 |
| Response IP | 152.71.0.42 |
| Found | Yes |
| Hash | 4f692d4cce28856fe6edb1c93b22f11cf4841e350d3248170b6132f562108079 |
| SimHash | 621039136a9a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.axd$ |
| Disallow | /apps/site_errors/ |
| Disallow | /apps/api/ |
| Disallow | /App_Data/ |
| Disallow | /archived/ |
| Disallow | /cels/ |
| Disallow | /corporate-hr/ |
| Disallow | /clearing/ |
| Disallow | /css/ |
| Disallow | /flash_players/ |
| Disallow | /flash_publications/ |
| Disallow | /media_player/ |
| Disallow | /rog/ |
| Disallow | /ssi/ |
| Disallow | /staffnet/ |
| Disallow | /topfolder/ |
| Disallow | /unknownpath/ |
| Disallow | /index.asp |
| Disallow | /email/ |
| Disallow | /study_with_us/document_uploads/offerterms1617/ |
| Disallow | /pete.html |
| Disallow | /jenny.html |
| Disallow | /jennytest.html |
| Disallow | /kiran/ |
| Disallow | /wiley-footer/ |
| Disallow | /apps/unipol/ |
| Disallow | /apps/CourseInduction/ |
| Disallow | /apps/pss/course_finder/ |
| Disallow | /apps/events/ |
| Disallow | /current_students/studying/exams/dates_deadlines_support/index.html |
| Disallow | /staffnet/staffnet_sites/site_links/122323.html |
| Disallow | /staffnet/staffnet_sites/site_links/122334.html |
| Disallow | /opendays/ |
| Disallow | /apps/staff_profiles/staff_directory/ |
| Disallow | /apps/research/groups/ |
| Disallow | /site_maintenance/ |
| Disallow | /study-and-courses/courses/our-students-stories/animal-rural-environmental-sciences/wilmie-burton |
| Disallow | /__data/assets/image/0015/201246/Wilmie-Burton.jpg |
| Disallow | /student_services/health_wellbeing/archived_stay_healthy/ |
| Disallow | /student_services/health_wellbeing/archived_self_help/ |
| Disallow | /library/using_the_library/tours/ |
| Disallow | /library/using_the_library/archived-tours/ |
| Disallow | /library/document_uploads/197408.pdf |
| Disallow | /adbe/courses/short_courses/certified%28archived%29/index.html |
| Disallow | /online_payment/ |
| Disallow | /smartcard/ |
funnelback
| Rule | Path |
|---|---|
| Allow | /staffnet/ |
| Allow | /corporate-hr/ |
| Disallow | /edu/teacher_training/ |
| Disallow | /student_services/document_uploads/184325.pdf |
| Disallow | /online_payment/ |
| Disallow | /smartcard/ |
| Disallow | /adapted_sports/ |
| Disallow | /music/ |
| Disallow | /about_ntu/governance/ |
| Disallow | /sustainability/carbon_elephant/bike-factory/hire_bike/index.html |
| Disallow | /old-cels/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.ntu.ac.uk/sitemap.xml |
Warnings
- 1 invalid line.