Feel guilty all you want for having less stress than your husband, but increasing yours just to equal things out is a horrible idea. 1. it doesn't help him in the least. 2. Your relationship now has another stress factor that could lead to you two having problems.
Yes, very much this! A few years ago, I was having meltdowns over the fact that the entire burden of breadwinning was mine and although my husband was performing a valuable role in our household by being available for the children so that I never had to worry about home while I was at work, he could organise his day however he liked and create opportunities to ride his bike, go for a short hike, meet friends, or just do nothing at all for a few hours while I was chained to an office desk being bombarded with tasks for 11 or 12 hours a day. I couldn't understand how someone who professed to love me could sit by and let me be so stressed and not offer to take some of the load off me.
On one occasion when I was sitting in a corner bawling my eyes out, he pointed out that the intention had never been that we would both be stressed, it was that neither of us would be stressed and we'd have time to spend together, and the solution wasn't for him to go out to work, which would add an extra dimension of stress to the household, it was for me to work fewer hours, in a different capacity if necessary.
"But we'll be skint," I protested.
"So? We'll just have to live within our means," DH replied.
I thought at the time that he was living in cloud cuckoo land, and I still don't think he realised how much money we needed just to tick over while all the children were at home, but fundamentally he was right. There was no point in him increasing his stress levels to match mine.
As far as the main question goes, I've walked out of several toxic workplaces while I could still hold my head up high, and wouldn't walk into a workplace I knew to be toxic. I would advise staying where you are for now; other opportunities will present themselves.