us.etrade.com
robots.txt
Robots Exclusion Standard data for us.etrade.com
Resource Scan
Scan Details
Site Domain | us.etrade.com |
Base Domain | etrade.com |
Scan Status | Ok |
Last Scan | 2024-09-01T09:26:40+00:00 |
Next Scan | 2024-10-01T09:26:40+00:00 |
Last Scan
Scanned | 2024-09-01T09:26:40+00:00 |
URL | https://us.etrade.com/robots.txt |
Domain IPs | 12.153.224.21, 198.93.34.50 |
Response IP | 65.196.177.40 |
Found | Yes |
Hash | 93b4ce02417be094343157c2b475b24f98a1f28332cdd9267f103ecf10d374dd |
SimHash | 031df058ce73 |
Groups
tag inspector spider
*
Rule | Path |
---|---|
Allow | /e/t/user/login |
Allow | /e/t/user/login_sp |
Allow | /e/t/user/login_etpro |
Allow | /e/t/user/retrieveuserid |
Allow | /e/t/user/resetpasswd |
Allow | /e/t/user/secureid-reorder |
Disallow | /b/ |
Disallow | /e/t/user/ |
Disallow | /app/ |
Disallow | /e/t/accounts/ |
Disallow | /e/t/advisor/ |
Disallow | /e/t/alerts/ |
Disallow | /e/t/bank/ |
Disallow | /e/t/commentary/ |
Disallow | /e/t/corpservices/ |
Disallow | /e/t/creditcard/ |
Disallow | /e/t/csp/ |
Disallow | /e/t/enrollment/ |
Disallow | /e/t/estation/ |
Disallow | /e/t/home/ |
Disallow | /e/t/invest/ |
Disallow | /e/t/ipo/ |
Disallow | /e/t/jumppage/ |
Disallow | /e/t/lending/ |
Disallow | /e/t/mou/ |
Disallow | /e/t/pfm/ |
Disallow | /e/t/plan/ |
Disallow | /e/t/prospectestation/ |
Disallow | /e/t/ria/ |
Disallow | /e/t/user/speedbump |
Disallow | /e/t/stockplan/ |
Disallow | /e/t/toareq/ |
Disallow | /e/t/applogic/ |
Disallow | /e/t/gmc/ |
Disallow | /e/t/iradist/ |
Disallow | /e/t/investingandtrading/ |
Disallow | /e/t/scenter |
Disallow | /e/t/optionanalystics |
Disallow | /flash/ |
Other Records
Field | Value |
---|---|
sitemap | https://us.etrade.com/sitemap.xml |