Yes, I think the 4% rule comes with some major caveats.
1) If the US's form of government changed, for example to resemble Russia's one-party corruption state with a single leader, I don't think the past would be relevant to the future. A period of intense ethnic or political violence could also break the trust systems through which the modern economy operates.
2) If the US dollar stopped being the world's reserve currency, the past would not be as relevant.
3) If an event occurred such as a nuclear war, pandemic with millions of deaths, or a financial system collapse, ...
4) If environmental degradation caused enough people to be unable to economically perform, we would see a similar outcome as Rome did with its lead pipes and loss of IQ. For funsies, check your drinking water stats here:
https://www.ewg.org/tapwater/5) A political collapse / economic collapse in China would cause inflation to skyrocket worldwide, and result in the dumping of investment assets by Chinese interests, including US treasuries and corporate assets.
6) If an industry or special interest attained sufficient political power to defend a monopoly, the cost of living could increase dramatically. For example, if homeowners across the US banded together to set strict codes preventing home construction like they did in California, then the price of housing could continue to skyrocket. Similarly, if other deep-moat industries did what colleges and universities did and built massive administrative bloat into their structures to increase executive salaries, costs could go up for decades.
So basically, looking at the US during the 20th century is like looking at the luckiest country in the luckiest timeframe and declaring an economic rule based on that experience. Yes, it is still likely technology and innovation will continue driving productivity growth throughout the 21st century, but we shouldn't rule out a devastating war, a few economic crises, or widespread health problems changing the underlying assumptions of the 4% rule. We'll just have to accept that retirement is risky just as life is risky. There are no guarantees, so we can only take the plunge anyway.