content.schwab.com
robots.txt

Robots Exclusion Standard data for content.schwab.com

Resource Scan

Scan Details

Site Domain content.schwab.com
Base Domain schwab.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-19T16:05:25+00:00
Next Scan 2024-06-18T16:05:25+00:00

Last Successful Scan

Scanned2024-01-28T15:39:24+00:00
URL https://content.schwab.com/robots.txt
Domain IPs 23.32.29.107, 23.32.29.88
Response IP 23.52.40.90
Found Yes
Hash 9d394233ecea9b9f03e7957355733757a613a8822d07458360f3d08041c099d6
SimHash 2bc46f835981

Groups

*

Rule Path
Disallow /web/ns/
Disallow /web/retail/cc/globalaccount/
Disallow /web/retail/public/alpa
Disallow /web/retail/public/asset_allocation
Disallow /web/retail/public/bank
Disallow /bondinvestors
Disallow /cash-reward
Disallow /chairmanscircle
Disallow /chromebooks/
Disallow /web/scs/db/citi
Disallow /client/tradesource
Disallow /web/corporate/sit
Disallow /web/as/public/costbasis
Disallow /email
Disallow /web/as/public/etf_onesource
Disallow /feeweight
Disallow /fee-weight
Disallow /flash/streetsmartedge
Disallow /web/retail/public/get-started
Disallow /global_investing
Disallow /web/retail/public/ira_401k_promo
Disallow /learningcenter
Disallow /m/Chinese
Disallow /m/ETFs
Disallow /m/hyic
Disallow /m/q111
Disallow /m/q211
Disallow /m/q308
Disallow /m/q309
Disallow /m/q311
Disallow /m/q410
Disallow /m/q411
Disallow /m/rps_mobile
Disallow /m/start_trading
Disallow /mobile/bank
Disallow /flash/movetosse
Disallow /web/trading/public/noii
Disallow /open_ira
Disallow /web/retail/public/openira
Disallow /openira-1
Disallow /openira-2
Disallow /own-your-tomorrow
Disallow /web/retail/public/apple
Disallow /web/retail/public/cboe
Disallow /web/retail/public/cshk_nce
Disallow /web/retail/public/public/etfs
Disallow /web/retail/public/intl_nce
Disallow /web/retail/public/public/mobile
Disallow /web/retail/public/public/newyork
Disallow /web/retail/public/retirement
Disallow /web/retail/public/start
Disallow /web/corporate/rethinkyour401k
Disallow /schwab_intelligent_portfolios
Disallow /schwab_trading_services
Disallow /web/scs/rps/ira
Disallow /web/trading/public/stocklanding
Disallow /web/retail/public/wealthmanagement
Disallow /web/international
Disallow /web/scs/sps
Disallow /web/trading/client/optionsxpress
Disallow /web/trading/public/optionsxpress
Disallow /web/retail/public/windhaven_event
Disallow /web/trading/public/ykblp
Disallow /w8

gsa-crawler

Rule Path
Disallow /web/ns/
Disallow /web/scs/sps/
Disallow /web/retail/cc/globalaccount/

Warnings

  • `noindex` is not a known field.