mass.edu
robots.txt
Robots Exclusion Standard data for mass.edu
Resource Scan
Scan Details
| Site Domain | mass.edu |
| Base Domain | mass.edu |
| Scan Status | Ok |
| Last Scan | 2024-06-09T07:07:30+00:00 |
| Next Scan | 2024-07-09T07:07:30+00:00 |
Last Scan
| Scanned | 2024-06-09T07:07:30+00:00 |
| URL | https://www.mass.edu/robots.txt |
| Domain IPs | 18.155.68.14, 18.155.68.19, 18.155.68.25, 18.155.68.28 |
| Response IP | 18.155.68.25 |
| Found | Yes |
| Hash | a107eb567d51d665e1a80045095022b5de346b664114ba93ffb8dd9c470d6c65 |
| SimHash | 4c67f045cd97 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /test/ |
| Disallow | /_Assets/ |
| Disallow | /_contentincludes/ |
| Disallow | /_includes/ |
| Disallow | /downloads/ |
| Disallow | /vpd/ |
| Disallow | /RD2014/ |
| Disallow | /rd2014/ |
| Disallow | /campuses/ |
| Disallow | /currentinit/ |
| Disallow | /foremployees/ |
| Disallow | /forinstitutions/ |
| Disallow | /forstudents/ |
| Disallow | /aboutus/ |
| Disallow | /library/ |
| Disallow | /pollibrary/ |
| Disallow | /studentlearning/ |
| Disallow | /share/ |
| Disallow | /masstransfer/pathwaysbeta/ |
| Disallow | /masstransfer/a2b/mapped/ |
| Disallow | /masstransfer/test-maguarantee/ |
| Disallow | /socialanalytics/ |
| Disallow | /databases/ |
| Disallow | /strategic2019/ |
| Disallow | /zz-2018styleguidebeta/ |
| Disallow | /datacenter/2020enrollmentestimates_October.asp |
| Disallow | /strategic/zzztagtest-top-a.asp |
| Disallow | /nahi/ |