Jerod,
You only live once and more importantly, you are only young once. Your position in life and the way you think about things in 3 years will be very different from today. I encourage you to commit to take more risks in your youth because you can always work towards F.I. later if you maintain the low-spending habits. If you can get a 60K engineering job out of college, its a pretty safe bet you can get a similar job after taking a couple years off. But you have this agreement with your parents and boss you are trying to honor.
However, it does not seem like you have a specific adventure in mind yet, just the fantasy that it would be nice to do one of these off-the-wall things. Say you wanted to be a circus performer. There are ways to mitigate the risk: I would spend your free time learning, researching, investing in classes, talking to circus performers and trying it out on the weekends / vacations. Say after a few months, you realize it is not your cup of tea, then focus on another adventure, like mountain climbing. Try indoor gyms, climbing on weekends, etc. If you really enjoy it, then declare a quit date (maybe exactly on the day you will complete 3 years of your job) and go for it.
If you try a bunch of hobbies and realize they all suck, then you would not have regrets about continuing your day job.
I think this is much lower risk than the alternative which is quitting your job first and then figuring out what to do.