Any tax-advantaged account is worth moving: get the Roth IRA to Vanguard right away. Figure out which asset classes you want and get the appropriate funds there. You'll pay only the exit fee from whoever holds your account. Put future contributions in through Vanguard (note: the limit is
per year, not
per account - moving to Vanguard doesn't reset the $5500). This will keep you with low expenses and without paying loads at any point.
The taxable is a bit trickier, because getting out of the funds involves capital gains taxes. The load is lost, but you still want to get out of the high expense ratios.
Who holds the funds? Is it now self-directed at Fidelity or is through a financial manager? If the latter, opt out of having this person manage your funds, because the goal is to get out of them.
First, stop re-investing the distributions (dividends, etc). Those are taxed when they happen
anyway, and the funds you want the money in don't charge loads. Use those to contribute to other parts of your stash that are in better funds. This will also ensure you don't have any portion of the fund resetting the clock on long-term gains.
Next, look into which funds are at a loss - you can use losses against gains to minimize the tax bill of the sale. Alternately, look at how much is in short- or long- term gains; the latter is taxed at a lower rate, but if it's much larger than the short-term gains, you might want to consider selling some or all of them now. Alternately, if short-term gains are significant, it might be worth it to wait until a year has passed since the last contribution for everything to be at long-term rates instead.
(someone should chime in to determine if selling taxable mutual funds affects AGI for purposes of Roth IRA limits; I don't know the answer to that)
As for setting up the new taxable stash, check out
Principles of tax-efficient fund placement - if you're holding international stocks (and I believe you should), hold it in taxable (if your portfolio spans both tax treatments).
