twcbc.com
robots.txt

Robots Exclusion Standard data for twcbc.com

Resource Scan

Scan Details

Site Domain twcbc.com
Base Domain twcbc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-07T12:46:04+00:00
Next Scan 2024-12-06T12:46:04+00:00

Last Successful Scan

Scanned2022-10-15T18:44:48+00:00
URL https://twcbc.com/robots.txt
Response IP 142.136.81.136, 142.136.168.7, 142.136.168.58, 142.136.81.135
Found Yes
Hash 7b0b04d2a4fce38c9ae0312415df3fa093e2522ca436362b75c46f12f7aaf8b3
SimHash e830d89aed96

Groups

*

Rule Path
Allow /etc/clientlibs/*.css
Allow /etc/designs/*.css
Allow /etc/clientlibs/*.js
Disallow /browse/content/lfo-3p-phase3_39-sp-btm.html
Disallow /browse/content/lfo-1pi-phase3_39-sp-btm.html
Disallow /browse/content/lfo-1pv-phase3_39-sp-btm.html
Disallow /Landing/mycheck/Charter-Contract-Buyout-Form.pdf%20.html
Disallow /single.html
Disallow /lp/ban/bundles.html
Disallow /lp/ban/internet.html
Disallow /lp/ban/phone.html
Disallow /lp/ban/nocontracts.html
Disallow /buyflow-qa1.html
Disallow /buyflow-sit1/localization.html
Disallow /buyflow-qa2/address-clarify.html
Disallow /buyflow-sit2.html
Disallow /buyflow-qa1/localization-error.html
Disallow /buyflow-qa1/address-clarify.html
Disallow /buyflow-qa1/invalid-address-zip.html
Disallow /buyflow-qa2/preprocess.html
Disallow /buyflow-qa1/localization.html
Disallow /buyflow-sit1/address-multiple.html
Disallow /myaccount
Disallow /checkout
Disallow /microsite
Disallow /home
Disallow /content/spectrum/business/en/404
Disallow /content/spectrum/business/en/maintenance
Disallow /content/spectrum/business/en/global-elements
Disallow /content/spectrum/business/en/company
Disallow /content/spectrum/business/en/templates
Disallow /content/spectrum/business/fed
Disallow /content/spectrum/business/qa-testing-sandbox
Disallow /content/spectrum/business/microsites
Disallow /content/campaigns/spectrum-business

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://business.spectrum.com/sitemap.xml

Comments

  • Allowed Paths
  • Excluded Pages
  • Excluded Paths