As suggested I might look into a refi if that's feasible for you. You could even look at doing it with no closing costs (paying a slightly higher interest rate) which is what we normally do, although we do it primarily because DW and I are never ready to commit to how long we will stay in the house.
I think if I were in your shoes I would not pay it off early--if you need to tap retirement savings to pay it you can always do so when the crisis happens. The money is there whenever you need it. You could even look at a refi over a longer time period, like 15 years which has great rates right now, and just make extra principal payments to pay it off over the planned 7 years. That way your required minimum is lower if you ever had the career crisis you're worried about.
That might also make you more comfortable about paying off the credit cards earlier, and if I were in your shoes, since you have no withdrawal penalties I would look at dipping into retirement savings to pay that off. I have to imagine that interest rate is at or above what you'd be making with investments, it's not tax-deductible, and it's a guaranteed return. Barring bankruptcy, you owe the money and have to pay it eventually, so paying it off faster will eliminate a ton of interest, and let you use more of your income to replace and grow retirement savings from that point forward. I'd also be cutting my lifestyle to the bone until that credit card debt is gone.
All that said, I don't think there's anything seriously wrong with paying off your house early, I certainly wish ours was paid off, and our interest rate is less than 4%. The risk is what's worrying you, and what makes me wish ours was paid off--we could lose our house if something really bad happens, and it would feel really great to not have that worry, and to have the resulting flexibility in career/retirement choices. We don't have any credit card debt though, our mortgage is our only debt. If we did have credit card debt I'd be doing every possible thing I could think of to get rid of that ASAP.