The US market has never (historically) failed for a 3% withdrawal rate.
4% of $500,000 is $20,000.
3% of $500,000 is $15,000.
So, in principle, if you can cut expenses by $5,000 or come up with some income for $5,000, or any combination of the two, your withdrawal rate should be low enough to recover. At least, if the future is not seriously worse than the past.
$5,000 isn't that hard to come by. With a guesstimate for taxes, you're talking about 5 month's worth of full-time work at the national minimum wage. Or, realistically, up to 10 months at 20 hours/week.
Or it's about mowing 6 yards a week for 6 months.
Not that hard to make up the difference.
Frankly, if your FIRE budget doesn't have at least $5,000 worth of fun money in it, I think you're cutting it too close. :)
Now, if you need $40,000 to live on instead of $20,000, you've just doubled the amount of savings or income you will need to come up with. And another doubling for $80,000 of income!
So, the ability to come up with part time work that can raise that amount of money gets harder as your FIRE income requirements get higher.
We have enough fluff in our budget to keep our withdrawal rate pretty low if we need it to. We diversified into additional income streams besides social security and stock dividends/sales. We're also using real estate rental property and farm rental income to cover our expenses. All but one of our six properties will be fully paid for by the time we retire next spring so that keeps our fixed expenses lower.
As you read more threads on the forum, you'll find that I'm on the "be extra safe" side of the discussion. Partly that's because I'm generally cautious about money matters and partly it's because of our ages. I'm 59 and my wife is older. Once she retires it would be a miracle if she found full time employment in her field again. (Not too hard for me to do so over the next 5 years if I spend a bit of my new free time to stay current in my field.)
Others will argue that you should retire earlier and go back to work if need be, otherwise you're working longer than you had to if the market does well.
Both positions have a lot of merit in them. Pick one and take your chances! :)