I'm extremely cheap and frugal but housing is where I draw the line. You must live in a safe environment free of dangers. The fact that you have a family...WTF are you still doing there.
My thoughts exactly ^^^
Nothing is as important to me as my/our safety and a home and garden that I can enjoy, without fear of strangers walking in my yard and threatening me or doing me harm or damaging my parked car.
We were edging into a similar situation about two years ago - a fair number of small bungalows suddenly for rent, instead of for sale as a home. Too many for sale signs...
When I trolled the local police reports, I noted increased crime and theft in the area. No druggies yet, although there was a raid in one of the condos a mile down the street which turned into a big drug bust.
I kept an eye on the situation and was just about to have the talk with Mr. R. which would have meant a move - non-negotiable. I held off a couple of months only because it is the only home he ever lived in and a home he inherited from his dad. I was beyond relief when all the homes became homes again, not rentals and a couple of bad lots were turned into upscale condominiums.
Everyone started sprucing up their place with new roofs and paint and pretty white vinyl fencing - huge sigh of relief, not to mention property values have spiked.
We live in a unique neighborhood with a mix of 1-2million dollar homes and horse ranches next to trailer parks next to small bungalows and condos and apartments. So the decline wasn't quite as obvious to spot as in a "normal" residental neighborhood.
We benefitted from our entire region becoming truly expensive living. Our area is one of the last pockets with good size lots and quick, easy access to anything from airports to beaches to shopping and entertainment. We have a double lot on a corner which I hope will one day pay off handsomely.
Bottomline, I was ready to give up my beloved garden and move, rather than becoming another statistic, i.e. old lady accosted in her own home.
OP - I understand that you are in a tough situation, but it is time to cut your losses and move on. It would not be smart to follow up one bad decision with another. If something happened to your wife and kids you would never forgive yourself - this has absolutely nothing to do with frugality, you are endangering your family and yourself.
Edited to add that Real Estate is a tricky business and even the pros don't know what may happen, you couldn't know that this would turn out a bad decision - neighborhoods can turn quick for any number of reasons, sometimes simply due to a major employer picking up stakes like I saw in Illinois.
It may temporarily create a big financial mess, but maybe by moving your wife might have a better chance at a job?
Start thinking and talking about possibilities - this may be a blessing in disguise.