I'd kill it. Yes, your hair is on fire. As others pointed out, it's worth to have one less thing to track, no more conversations with your husband on it, keep's life simple. Even if you save ~$140-$150 throughout the year, that is still important money.
Since you have the money sitting in an account, probably earning less interest, couldn't begin replenishing your emergency fund? use a credit card, if you have the balance, if a true emergency.
It feels awesome to have no debt.....you are not there yet. GL with getting your husband on board.