www.khoury.northeastern.edu
robots.txt
Robots Exclusion Standard data for www.khoury.northeastern.edu
Resource Scan
Scan Details
| Site Domain | www.khoury.northeastern.edu |
| Base Domain | northeastern.edu |
| Scan Status | Ok |
| Last Scan | 2025-06-27T07:48:15+00:00 |
| Next Scan | 2025-07-27T07:48:15+00:00 |
Last Scan
| Scanned | 2025-06-27T07:48:15+00:00 |
| URL | https://www.khoury.northeastern.edu/robots.txt |
| Domain IPs | 52.70.229.197 |
| Response IP | 52.70.229.197 |
| Found | Yes |
| Hash | aee9316a0378c7d6f56a77fd89180b922b50a347cd81e151805e473e042eff70 |
| SimHash | 846279a45eba |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /programs/0/ |
| Disallow | /people_roles/ |
| Disallow | /category/ |
| Disallow | /tag/ |
| Disallow | /community/ |
| Disallow | /educational_pathways/ |
| Disallow | /news_categories/ |
| Disallow | /khoury_college/ |
| Disallow | /degrees/ |
| Disallow | /institutions/ |
| Disallow | /areas_of_study/ |
| Disallow | /audience/ |
| Disallow | /events_blog/ |
| Disallow | /image_category/ |
| Disallow | /author/ |
| Disallow | /venue/ |
| Disallow | /timeline/ |
| Disallow | /ctl-stories/ |