Why do you want a nicer house? Is your current house not meeting your needs? e.g. bad floor plan, not enough beds/baths, wanting to expand the family, kitchen too small, no garage, no garden, etc.
How do you define nice? Just bigger, better location, newer, older, better finishes, more land? Can you remodel your existing house to get what you want?
I have a way too big/nice house that requires a lot of time consuming and expensive maintenance. 100 year old house with huge barn and 18 acres, tons of trees near the house that always need trimming and mowing around, tractor for snow removal, need to maintain tractor, riding mower, truck. Stuff in the house always breaking or just looking dirty and messy. Junk accumulating. Outside landscaping looks like shit because we just don't have time. I am sick of all of it.
We landed in this house because our old one was not meeting our needs when we wanted to have children (tiny kitchen, only one bathroom, bad floor plan). I really just wanted a bigger kitchen and a second bathroom, but the husband mentioned a dream of always wanting to live in the country, so here we are. The location is close enough to town that I can still bike to work, and the views are pretty, I will give it that. We both got something we wanted, just didn't realize that we were buying a job.
I am trying to talk my spouse into selling it and buying a modest home for cash with the equity that we have in it, thus completely eliminating the mortgage payment, cutting the utilities, taxes, and maintenance costs substantially, and also reducing the amount of time needed for maintenance. We have enjoyed this house but we have little children and we can't really keep the house maintained and looking nice, so it is a lot of stress. Kids would be happier in a neighborhood too because they would have friends to play with.