Yeah, people think you're weird.
Also, there's a whole lot of mental gymnastics and soul searching and contemplation required. It's actually a lot of work--at least for me. I'm always thinking through what I really want to do, and how best to get there, and how quickly I'll feel comfortable doing it, and what's that target number, and would I be able to do this risky career move in exchange for downshifting a little more early. It's a lot "easier" (in one sense) just to keep the pedal to the floor on the earnings and just spend on whatever you want to as long as there's money in the account.