wpi.edu
robots.txt
Robots Exclusion Standard data for wpi.edu
Resource Scan
Scan Details
| Site Domain | wpi.edu |
| Base Domain | wpi.edu |
| Scan Status | Ok |
| Last Scan | 2025-03-06T05:44:55+00:00 |
| Next Scan | 2025-03-20T05:44:55+00:00 |
Last Scan
| Scanned | 2025-03-06T05:44:55+00:00 |
| URL | https://wpi.edu/robots.txt |
| Domain IPs | 130.215.36.26 |
| Response IP | 130.215.36.26 |
| Found | Yes |
| Hash | 6765fbb1921ddc3a552fa2853c62a069f13075c1176c4af4898f7f9e5d4e32ef |
| SimHash | a2f4de247cd1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Devel/ |
| Disallow | /April/ |
| Disallow | /Academics/Depts/Fire/Lab/Safety/ |
| Disallow | /Academics/Depts/IGSD/Interactions/ |
| Disallow | /Academics/Library/Databases/Gartner/ |
| Disallow | /Academics/Library/Web/Specials/ |
| Disallow | /Admin/SAO/NSO/Project/ |
| Disallow | /Admin/President/News/costs.html |
| Disallow | /Admin/Alumni/News/tsunamis.html |
| Disallow | /Campus/Faculty/CAO/ |
| Disallow | /Campus/Faculty/CAP/ |
| Disallow | /Campus/Faculty/CGSR/ |
| Disallow | /Campus/Faculty/CTAF/ |
| Disallow | /Campus/Faculty/COAP/ |
| Disallow | /Campus/Faculty/FBC/ |
| Disallow | /Campus/Faculty/FAP/ |
| Disallow | /Campus/Faculty/Handbook/ |
| Disallow | /Campus/Faculty/Meetings/ |
| Disallow | /VH/ |
| Disallow | /Stratplan/ |
| Disallow | /Stratalum/ |
| Disallow | /Intranet/ |
| Disallow | *.txt |
| Disallow | /cgi-bin/ |
| Disallow | ~improv/kilroy/archive |
| Disallow | /~improv/kilroy/archive |
| Disallow | /Academics/CCC/Services/Databases/ |
| Disallow | /Reddot/ |
| Disallow | /Academics/CCC/Help/Software/office2013/ |
| Disallow | /*.pl$ |
| Disallow | /offices/president/webcast.html |
| Disallow | /academics/cee/engineering-exam.html |
| Disallow | /academics/initiatives/china.html |
| Disallow | /academics/initiatives.html |
| Disallow | /ETD-db/ |
| Disallow | /E-project-db/ |