hw.com
robots.txt
Robots Exclusion Standard data for hw.com
Resource Scan
Scan Details
| Site Domain | hw.com |
| Base Domain | hw.com |
| Scan Status | Ok |
| Last Scan | 2025-08-15T22:36:46+00:00 |
| Next Scan | 2025-09-14T22:36:46+00:00 |
Last Scan
| Scanned | 2025-08-15T22:36:46+00:00 |
| URL | https://hw.com/robots.txt |
| Domain IPs | 67.209.48.66 |
| Response IP | 67.209.48.66 |
| Found | Yes |
| Hash | 705627349bec3d0fa47ef074c07150c8ff3d00603372a6cab66be5884ac63b4f |
| SimHash | a059174ae445 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | /portals/0/ | - |
| Disallow | /academics/departments/mathematics/galleries-of-student-work/ | - |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /athletics/News-Archives/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /DesktopModules/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /images/ | - |
| Disallow | /Install/ | - |
| Disallow | /Newsarticles/ | - |
| Disallow | /News-Archives/ | - |
| Disallow | /Portals/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/Search/ | - |
| Disallow | /Resources/Shared/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /News/view/sendemail/ | - |
| Disallow | /sendemail/ | - |
| Disallow | /Login/ | - |
| Disallow | /about/Login/ | - |
| Disallow | /academics/Login/ | - |
| Disallow | /giving/Login/ | - |
| Disallow | /alumni/LogIn/ | - |
| Disallow | /athletics/Login/ | - |
| Disallow | /boxoffice/Login/ | - |
| Disallow | /calendar/Login/ | - |
| Disallow | /communitycouncil/Login/ | - |
| Disallow | /filmfestival/Login/ | - |
| Disallow | /msbookstore/Login/ | - |
| Disallow | /mslibrary/Login/ | - |
| Disallow | /msoutreach/Login/ | - |
| Disallow | /usdeans/Login/ | - |
| Disallow | /usbookstore/Login/ | - |
| Disallow | /uslibrary/Login/ | - |
| Disallow | /uspeertutoring/Login/ | - |
| Disallow | /students/Login/ | - |
| Disallow | /summeropportunities/Login/ | - |
| Disallow | /summerprograms/Login/ | - |
| Disallow | /trustees/Login/ | - |
| Disallow | /admission/Login/ | - |
| Disallow | /alumni/Welcome/Login/ | - |
| Disallow | /parents/Welcome/Login-Page/ | - |
| Disallow | /about/Contact-Us/Send-a-Message*/ | - |
| Disallow | /about/Contact-Us/Send-Us-A-Message*/ | - |
| Disallow | /calendar/Calendar/View/Subscriptions | - |
slurp
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*/ctl/ | Slurp permits * |
| Disallow | /HttpModules/ | - |
| Disallow | /images/ | - |
| Disallow | /Install/ | - |
| Disallow | /js/ | - |
| Disallow | /Portals/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/Search/ | - |
| Disallow | /Resources/Shared/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
dnnsearch
| Rule | Path |
|---|---|
| Disallow | /DesktopModules/ |
| Disallow | /calendar/ |
| Disallow | /portals/3/ |
| Disallow | /athletics/News-Archives/ |
| Disallow | /News/view/sendemail/ |
| Disallow | /News-Archives/ |
| Disallow | /News-Archives/ctl*/ |
| Disallow | /News/tabid/1837/view/sendemail/ |
| Disallow | /News/tabid/1837/mid/5833/forumid/ |
| Disallow | /abouthw/ContactUs/SendUsAMessage/ |
| Disallow | /abouthw/ContactUs/SendaMessage/ |
| Disallow | /ForgotUsername/ |
| Disallow | /Login/ |
| Disallow | /LoginPage/ |
| Disallow | /about/Login/ |
| Disallow | /academics/Login/ |
| Disallow | /academics/Login/ |
| Disallow | /giving/Login/ |
| Disallow | /alumni/LogIn/ |
| Disallow | /athletics/Login/ |
| Disallow | /boxoffice/Login/ |
| Disallow | /box/Login/ |
| Disallow | /calendar/Login/ |
| Disallow | /communitycouncil/Login/ |
| Disallow | /msbookstore/Login/ |
| Disallow | /mslibrary/Login/ |
| Disallow | /msoutreach/Login/ |
| Disallow | /usdeans/Login/ |
| Disallow | /usbookstore/Login/ |
| Disallow | /uslibrary/Login/ |
| Disallow | /uspeertutoring/Login/ |
| Disallow | /stud/Login/ |
| Disallow | /students/Login/ |
| Disallow | /summeropportunities/Login/ |
| Disallow | /summerprograms/Login/ |
| Disallow | /trustees/Login |
| Disallow | /admission/Login/ |
| Disallow | /alumni/Welcome/Login/ |
| Disallow | /parents/Welcome/Login-Page/ |
| Disallow | /about/Contact-Us/Send-a-Message*/ |
| Disallow | /about/Contact-Us/Send-Us-A-Message*/ |
Comments