Not quite the same, but I was offered the chance to inherit my grandparent's house: it was a three bedroom country house about 300 years old, with lovely stone mullioned windows to the main rooms and old wooden beams across the ceilings. Both my grandparents on that side died while I was still a child but I have fond memories of them and the working well, the double seater privy, the wood-fired kitchen stove, the old brick cellar and the one of a kind apple tree.
I turned the offer down because the person offering it to me wanted me to commit to living in the house and I wasn't prepared to limit my life choices in that way. A young family now live in it very happily - with some modernisations I'm probably quite pleased not to have seen.
Someone else will similarly cherish/change your family home if you leave it now for new adventures. Of course, if you decide to stay that just means that someone else will cherish/change it after you die, and in the long run whether the change in ownership happens now or later isn't going to matter to the house.
I would counsel doing what you think will make you happy and that you will regret the least, and accepting that you don't control what will happen to the house when you leave it, as you surely will one way or another.
