jbu.edu
robots.txt
Robots Exclusion Standard data for jbu.edu
Resource Scan
Scan Details
| Site Domain | jbu.edu |
| Base Domain | jbu.edu |
| Scan Status | Ok |
| Last Scan | 2024-10-28T06:34:17+00:00 |
| Next Scan | 2024-11-27T06:34:17+00:00 |
Last Scan
| Scanned | 2024-10-28T06:34:17+00:00 |
| URL | https://www.jbu.edu/robots.txt |
| Domain IPs | 199.60.103.227, 199.60.103.29, 2606:2c40::c73c:671d, 2606:2c40::c73c:67e3 |
| Response IP | 199.60.103.227 |
| Found | Yes |
| Hash | e8f1cc0eba65f6cf6dbe63d8455cd2af513b8b3a5e41a2e4c7ed191b3e448567 |
| SimHash | 0879c560e633 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |
rogerbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | advocate.jbu.edu |
| Disallow | eaglenet.jbu.edu |
| Disallow | /news/feature-stories/ |
| Disallow | admissions.jbu.edu |
| Disallow | /news/press-releases/ |
| Disallow | help.jbu.edu |
| Disallow | library-catalog.jbu.edu |
| Disallow | adfs.eaglenet.jbu.edu |
| Disallow | library.jbu.edu |
| Disallow | /test/ |
| Disallow | /_hcms/preview/ |
| Disallow | /hs/manage-preferences/ |
| Disallow | /hs/preferences-center/ |
| Disallow | /*?*hs_preview=* |
| Disallow | /*?*hsCacheBuster=* |