Don't put off traveling if that's what you want to do. Financial freedom isn't just about quitting full time work, it's about being able to do the things you care about and make memories that will last a lifetime. Seriously, if trips make you happy, find ways to do them economically--backpack, hostels, travel hacking with credit cards, stay with friends (if you don't have international friends, make some!), maybe even volunteer somewhere for free lodging, etc.
I have never regretted spending money on travel.