There are many mid-size cities in Western US where you can still buy houses under $400K. If you are FIREed, a mid-size city may be better due to slower pace, friendlier neighborhood, and cheaper. The internet, e-commerce and big stores can make them less remote too. They can be around 1-2 hours drive to the big cities. If I were in your shoes, I'd cast the net wider and check out other places.
If it makes you feel better, keep working 1-2 years, especially if you can negotiate a remote working :-)
Good luck!
P.s. Apply mortgages while you have a job. Otherwise it's so much harder and more expensive without the job. The bankers still don't get FIRE people is much safer than people with jobs, which can go away anytime.