Low fees made the group a passive investing powerhouse. But it needs to improve tech and service as it pushes into wealth management and cash accounts