Unless you were a very late starter in the workforce, and plan on making a huge salary in future....
First, secure a MINIMUM retirement fund for yourself at age 65.. e.g., do you have $200k NOW that you will not touch in your retirement fund? This should grow to $500k or better, and generate $20k in income during retirement.
Now, with that out of the way, you have choices.
If you have more money than that, you can choose to keep in retirement for earlier FIRE or larger income in retirement, and find another way for house accommodation (financing or renting), or you can choose to use it on housing.
It's your life. Just don't get trapped in the "forever home" or "Buy the most house you can afford" commentary. It's a TRAP.