Where is your money now and how is it invested?
Moving to Vanguard or Fidelity usually makes sense, but not always. For example, you may incur significant capital gains in taxable accounts if you sell funds. That may outweigh the lower cost benefit. Also, if you have some excellent long term performers, you may be better off keeping them.