willstrohl.com
robots.txt
Robots Exclusion Standard data for willstrohl.com
Resource Scan
Scan Details
| Site Domain | willstrohl.com |
| Base Domain | willstrohl.com |
| Scan Status | Ok |
| Last Scan | 2025-10-14T02:56:04+00:00 |
| Next Scan | 2025-10-28T02:56:04+00:00 |
Last Scan
| Scanned | 2025-10-14T02:56:04+00:00 |
| URL | https://willstrohl.com/robots.txt |
| Domain IPs | 104.21.6.207, 172.67.135.68, 2606:4700:3034::6815:6cf, 2606:4700:3034::ac43:8744 |
| Response IP | 104.21.6.207 |
| Found | Yes |
| Hash | e2ce577669843db29b411ab096f83cab640c5210a8c12ecb77c0f4c594f56550 |
| SimHash | 5a040145c8c5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/ctl/ |
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Providers/ |
| Disallow | /Resources/ |
| Disallow | /privacy/ |
| Disallow | /terms/ |
msnbot-udiscovery/2.0b
| Rule | Path |
|---|---|
| Disallow | /*/ctl/ |
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Portals/ |
| Disallow | /Providers/ |
msnbot
| Rule | Path |
|---|---|
| Disallow | /*/ctl/ |
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Portals/ |
| Disallow | /Providers/ |
slurp
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Portals/ |
| Disallow | /Providers/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /*/ctl/ |
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Portals/ |
| Disallow | /Providers/ |
| Disallow | /Resources/ |
feedfetcher-google
| Rule | Path |
|---|---|
| Disallow | /*/ctl/ |
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Portals/ |
| Disallow | /Providers/ |
| Disallow | /Resources/ |
yahoo pipes 1.0
| Rule | Path |
|---|---|
| Disallow | /*/ctl/ |
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Portals/ |
| Disallow | /Providers/ |
| Disallow | /Resources/ |
blogpulselive
| Rule | Path |
|---|---|
| Disallow | /*/ctl/ |
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Portals/ |
| Disallow | /Providers/ |
| Disallow | /Resources/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.willstrohl.com/sitemap.aspx |
| sitemap | http://www.willstrohl.com/DesktopModules/LiveBlog/Handlers/SiteMap.ashx?PortalId=1&ModuleId=1142 |
Warnings
- 3 invalid lines.