I'm in a pretty similar position as my current expenses are about $45k a year, however they were much higher before and have been coming down slowly but surely. I have been able to lower my expenses while growing our family, two boys 3 and 1 years old.
You say that you do not like your job but will work longer because your expenses are X amount. Why not get them down, lowering expenses does not mean lowering your standard of living. For me it's just learning new skills and implementing them. Another thing to consider is your expense can go down once you actually stop working, less commute, eating, required clothes, more time to do things yourself instead of paying someone else to do them.
What do you plan to do when you retire? I myself can't imagine doing absolutely nothing, I intend to be somewhat productive and earn 20-30% of my expenses. So if you really do not like your job as much I do, and want to spend more time with family. There are other ways to retire early than just working longer so your stash covers your current expenses.
Good luck!