I hear you! We bought a house in 2008 in the Sunbelt. On its way down. Far, far from the bottom. Hated the city and moved back to CO in 2012 (back to a house we had rented out during the time we were away). Still took 2 more years to sell. Rented it out while we waited for the market to recover enough to dump the thing.
I was never so happy to wire a large amount of money to someone else as the day we closed on that crap! At the bank, I had explained that we were closing on a house which was why we needed to wire >$10,000. She winced when I further explained that we were the *sellers*. Thank goodness we could do this all remotely, because I would NOT have wanted to sit there writing a big check. Ugh. And that was definitely far from all we paid out besides the mortgage for those 3 years. Closing costs to purchase, improvements we made to the house, some of which were undone by the renters, cleanup costs from the renters, property management fees, HOA fees, etc. We would have done far, far better to rent. About the only thing I learned was how grow rosemary, and which landscape plants probably will do well in the unwatered area of our xeriscape. Also how to wield a pickax to dig a hole in baked clay. :-(
OTOH, not having a phone call that the police raided the house, the renters broke windows, the A/C was broken or gone, there were drug dealers, there was so much pet shit in the house that the renters removed the carpet, and on and on (each of those happened in either one or the other house during when we had it rented) was sooooo worth the money. I lived in fear of having a hoarder or meth cooker and having a completely uninhabitable/condemned house, which would have cost far more than the crap we did have happen. So, you may have saved yourself a hell of a headache by not renting it out. And if you learned a bunch about home maintenance, so much the better!