Just a word of caution, I'm not nearly as experienced as others who will come along and be able to explain exactly how you have to do what you have to do, but I can kind of help in that my wife and I were in a similar situation recently (albeit, with a much smaller fund).
First off, at the end of all of this you'll probably have the option to be FIRE within the next year or two...that's a HUGE stash!
Anyway, my wife has a trust in her name that she learned of when she turned 21. She has been using it to fund her education (almost done) and most recently, we spoke with the fund manager about fees, etc. and she showed us that the fund was losing money on top of her being charged quarterly fees. It was not a pretty sight. We went back and reviewed the initial trust agreement from when it was established and determined that she was able to choose to close the account if she saw fit. So that's what we did, and the manager was happy to oblige because at then end of the day, it's her job. My wife has re-allocated the funds (which are better off as a whole). As a precaution, we have cash set aside for the impending tax bill next year.
Your situation is a little different. I would start by reviewing the terms of the initial trust and seeing just what your spouse has the ability to do. If the amount were smaller, and if it were within the bounds of the trust to do so, I would definitely say cut your losses, drain the trust, and properly re-allocate the funds - making sure you have enough liquid assets set aside for your tax bill next year.
However, with that amount of money, you're looking at a hairy situation. If it were my wife and I in your position, I would start making sizable withdrawals that you then put into accounts where your money can actually grow, taking enough money to make dents in the fund without sticking you with astronomical taxes. Again, though, I'm still not that well versed in optimizing these kinds of things so i caution you to take my advice with a grain of salt.
Essentially, the first thing you need to do is to sit down and review the terms of the trust and then discuss with your spouse just what you want to do with the money.