Congratulations on taking the plunge and acting on your inclinations. Just reading '5000 sq ft house' made me want to breathe into a paper bag.
Sure, it works for some people, but if your thing is freedom, being outdoors, relaxation, travel, and fun, the giant house just becomes a harness. And you have the option, it sounds like, of buying but not having a mortgage (or letting the proceeds grow as you pay off a low interest mortgage on a new place), now that is freedom!