Several commenters have already advised you to sell/downsize your house because doing so would allow you to FIRE right now. I'll agree, but with a twist. Do sell your house. But don't downsize/downgrade. Instead, find yourself a lower cost location to move to where you can get the "same" house you have now for a lot less money. That's what we did. Worked like a charm.
(And, oh, just remember that, once you do FIRE, commuting distance considerations are totally moot. And that, as far as family visiting goes, you can live 100 to 150 miles away and still manage those weekly visits without too much fuss.)
Good luck.