I have lived out in the county for many years, and would not want to live in a city. The pros far outweigh the cons, however it does cost more.
A couple notes:
a. Having rural water at the road should be nice, as you won't have to drill and maintain a well, plus water quality should be pretty good. You will just have to pay a tap fee to hook up and a monthly bill. Check with neighbors to make sure they don't have crazy high water charges first, some areas do.
b. I just put a septic system in for $5,000 and have seen them as high as $25,000, depends on your county health department requirements, type of soils, etc. Ask around to get a feel for what this will cost. With just the two of you, there shouldn't ever be any maintenance assuming it's a gravity draining system an not a pumped system.
c. Lawn / property upkeep takes time and money. The time and effort can be mitigated by owning good equipment for mowing, snow removal, etc. Most country folks kind of enjoy these activities.
d. Sure is nice to be able to build what you want rather than to be tied to restrictions. Also nice to have the space to enjoy, garden, privacy, etc. If you want a swimming pool, chickens, a new shed, items you mentioned, etc. there shouldn't be any road blocks.
Good luck !