EJ is the bottom-feeding slime that you should be scraping off your shoe as you run to the exit. If your husband is in charge of this office (it seems like he might be, but just doesn't care about switching?) then he needs to understand one thing: he is allowing scum to rob him and his employees legally. That is shitty. REALLY shitty.
If your husband does own the business and just doesn't want to be bothered... can't YOU change up to someplace like Vanguard? Just do the legwork, get the necessary paperwork, plop it in front of him and tell him to sign where he has to sign and then transfer all the accounts over and be happy. Unless the EJ is a family member or college buddy? In any case, you still could tell him "use me as an excuse if they call you about why you're leaving EJ - your mean ol' spouse is deadset on Vanguard so gotta keep the wife happy, sorry bud!" No one says you ever have to speak to that person again, and believe me, it isn't the first time an EJ adviser has been dumped and it won't be the last.
http://portfolio.morningstar.com/Rtport/Free/InstantXRayDEntry.aspx^this is Morningstar's way to analyze your portfolio; might help a bit
And I also agree you should not meet with the EJ salesguy (oops, "adviser"). He/she just wants to screw you even harder now, so it's pointless. They are trained to counter any argument and throw up all sorts of convincing charts and numbers to justify their insane fee and load structure. They prey on the elderly, the too busy, the naive/scared, and the lonely, and will try to make you feel like they are your buddy, your good friend... because it's harder to tell a "friend" to stop screwing you than if it was strictly a business relationship.
Just figure out the lowest cost, broadest market fund they offer, insist on that one, and tell them to not freaking touch anything else - no buying/trading/rebalancing - NOTHING. Their services are not required, and as soon as possible get the hell away from them - which will mean paying them transfer fees, closing account fees, allowing you to breathe fees... it would be worth it to get away from them.