Log In Sign Up

centurybk.com
robots.txt

Robots Exclusion Standard data for centurybk.com

Resource Scan

Scan Details

Site Domain centurybk.com
Base Domain centurybk.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-06-06T23:45:14+00:00
Next Scan 2024-07-06T23:45:14+00:00

Last Successful Scan

Scanned2024-04-15T22:16:24+00:00
URL https://centurybk.com/robots.txt
Domain IPs 23.52.171.202, 23.52.171.233
Response IP 23.52.171.233
Found Yes
Hash c1e7f644ade7e617b4898f9d5f5f4dc719c55c945ae2004e160c62825bd7df8f
SimHash 33cb155bc5d5

Groups

*

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Allow /images/ -
Disallow /Install/ -
Allow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles
Disallow /LinkClick.aspx -
Disallow /WebResource.axd -

msnbot

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Allow /images/ -
Disallow /Install/ -
Allow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles
Disallow /LinkClick.aspx -

Other Records

Field Value
crawl-delay 5

slurp

Rule Path Comment
Disallow /*/ctl/ Slurp permits *
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Allow /images/ -
Disallow /Install/ -
Allow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles
Disallow /LinkClick.aspx -

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path Comment
Disallow /*/ctl/ Googlebot permits *
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Allow /images/ -
Disallow /Install/ -
Allow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles
Disallow /LinkClick.aspx -
Allow /Portals/FirstNationalBankMountDora/Skins/FNBMD_skins/skin.css -
Allow /Portals/FirstNationalBankMountDora/Containers/FNBMD_containers/container.css -
Allow /Portals/FirstNationalBankMountDora/Containers/FNBMD_containers/CTA_hasTitle.css -
Allow /Portals/FirstNationalBankMountDora/portal.css -
Allow /Portals/FirstNationalBankMountDora/Skins/FNBMD_skins/css/bootstrap.min.css -
Allow /Portals/FirstNationalBankMountDora/Skins/FNBMD_skins/css/style.css -
Allow /Portals/FirstNationalBankMountDora/Skins/FNBMD_skins/css/custom.css -
Allow /Portals/FirstNationalBankMountDora/Skins/FNBMD_skins/js/bootstrap.min.js -
Allow /Portals/FirstNationalBankMountDora/Skins/FNBMD_skins/js/plugins.js -
Allow /Portals/FirstNationalBankMountDora/Skins/FNBMD_skins/js/scripts.js -
Allow /Portals/FirstNationalBankMountDora/Skins/FNBMD_skins/js/main.js -

yahoo pipes 1.0

Rule Path Comment
Disallow /admin/ -
Disallow /App_Browsers/ -
Disallow /App_Code/ -
Disallow /App_Data/ -
Disallow /App_GlobalResources/ -
Disallow /bin/ -
Disallow /Components/ -
Disallow /Config/ -
Disallow /contest/ -
Disallow /controls/ -
Disallow /DesktopModules/ -
Disallow /Documentation/ -
Disallow /HttpModules/ -
Allow /images/ -
Disallow /Install/ -
Allow /js/ -
Disallow /Portals/ -
Disallow /Providers/ -
Disallow /Resources/ContentRotator/ -
Disallow /Resources/ControlPanel/ -
Disallow /Resources/Dashboard/ -
Disallow /Resources/FeedBrowser/ -
Disallow /Resources/OpenForceAd/ -
Disallow /Resources/Search/ -
Disallow /Resources/Shared/ -
Disallow /Resources/SkinWidgets/ -
Disallow /Resources/TabStrip/ -
Disallow /Resources/Widgets/ -
Disallow /Activity-Feed/userId/ Do not index user profiles
Disallow /LinkClick.aspx -
Back to top

Comments

  • Begin robots.txt file
  • /-----------------------------------------------\
  • | In single portal/domain situations, uncomment the sitmap line and enter domain name
  • \-----------------------------------------------/
  • Sitemap: http://www.DomainNamehere.com/sitemap.aspx
  • End of robots.txt file
Back to top