You never said how much you spend in an average month, or at least how low you could get your spending. It's quite likely that if you spend 4% of your stache that it will end up growing in future, but if you can drop your spending low enough, like 3% it's almost guaranteed to grow.
Anything extra you can do by working part time etc will just increase the chances of you hitting your goal, eventually.
Ps. I'm in a similar boat, I'd like to hit a million dollars, but work keeps getting in the way of all the adventures I want to have! I could live on 2% and my side gig and then just wait it out until growth gets to me, but keep thinking how much faster I can get there if I keep working a little longer.