smithbucklin.com
robots.txt
Robots Exclusion Standard data for smithbucklin.com
Resource Scan
Scan Details
| Site Domain | smithbucklin.com |
| Base Domain | smithbucklin.com |
| Scan Status | Ok |
| Last Scan | 2025-11-26T18:39:48+00:00 |
| Next Scan | 2025-12-26T18:39:48+00:00 |
Last Scan
| Scanned | 2025-11-26T18:39:48+00:00 |
| URL | https://smithbucklin.com/robots.txt |
| Domain IPs | 38.106.217.152 |
| Response IP | 38.106.217.152 |
| Found | Yes |
| Hash | 21751a51878a1f2ac583bc0f665973344bbf62edf683545337ee365d1a9f4f22 |
| SimHash | 330d1553c5c7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /DesktopModules/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /images/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Portals/ |
| Disallow | /Providers/ |
| Disallow | /Resources/ContentRotator/ |
| Disallow | /Resources/ControlPanel/ |
| Disallow | /Resources/Dashboard/ |
| Disallow | /Resources/FeedBrowser/ |
| Disallow | /Resources/OpenForceAd/ |
| Disallow | /Resources/Search/ |
| Disallow | /Resources/Shared/ |
| Disallow | /Resources/SkinWidgets/ |
| Disallow | /Resources/TabStrip/ |
| Disallow | /Resources/Widgets/ |
| Disallow | /Activity-Feed/userId/ |
| Disallow | /Insights-OLD |
msnbot
| Rule | Path | Comment |
|---|---|---|
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /DesktopModules/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /images/ | - |
| Disallow | /Install/ | - |
| Disallow | /js/ | - |
| Disallow | /Portals/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/Search/ | - |
| Disallow | /Resources/Shared/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /Insights-OLD | - |
slurp
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*/ctl/ | Slurp permits * |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /DesktopModules/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /images/ | - |
| Disallow | /Install/ | - |
| Disallow | /js/ | - |
| Disallow | /Portals/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/Search/ | - |
| Disallow | /Resources/Shared/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /Insights-OLD | - |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*/ctl/ | Googlebot permits * |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /Install/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /Insights-OLD | - |
yahoo pipes 1.0
| Rule | Path | Comment |
|---|---|---|
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /DesktopModules/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /images/ | - |
| Disallow | /Install/ | - |
| Disallow | /js/ | - |
| Disallow | /Portals/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/Search/ | - |
| Disallow | /Resources/Shared/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /Insights-OLD | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.smithbucklin.com/sitemap.aspx |
Comments