My first thought is that house-hunting, selling, buying, packing, and moving will take a lot of time. Maybe several months' worth of commuting if you only go in 3x/week.
Our current place is ~10 minutes from family, and across the street from good friends. Moving would slightly increase the family distance and drastically increase the friends distance. My thought is that you don't go to see friends every day, while you go to work more often (3x a week in our case). But it still bums me out! I enjoy walking over for dinner or whatever.
To me, this is a strong argument against moving. You'll always go to work when you have to. But you rarely if ever
have to get together with your friends. If it takes 40 minutes of travel each way every time, you will see your friends
way less than you do now. You'll never say "hi" while mowing the lawn, or run over to borrow an egg, or issue a spur-of-the-moment invitation. That's a high price to pay.
I would instead think about optimising the commute for the best combination of money, time, environmental impact, and productivity. E.g. do part of it by bike, spend it in conversation/discussion with your wife, use the time to do phone tasks to free up the evenings,...