The worst possible outcome is not a crash in nominal terms, but high inflation like in the 70s. Cash and bonds (TIPS aside) would be the worst things to have in that case.
Warren Buffett, one of the few people who have reliably beat the market average, advocates passive investing. A hedge fund manager was not able to beat index funds after betting $1M that he could. You can say it's just chance, but it's not rocket science to hold shares of profitable companies and collect the earnings. If you do want to beat the market average reliably, you will need all the resources, skill, patience, and drive that Warren Buffett has to be able to truly value a given company. Then you're just working another very intensive job, so what's the point?
While you can't reliably beat the market in the very long term (unless you are Buffett), you can beat the crap out of it in the short term as many many people have done. Anyone in the tech field who got lucky with their company stock options has trounced the market returns. I know quite a few multi multi millionaires who were only making a $100k base salary. Someone with a $200k base salary could have purchased the options in those companies with the extra $70k (after taxes) and also become a multi multi milliionaire. It does seem easier though to be given the options as a part of compensation rather than take a higher compensation from another company and purchase the options yourself, even if the end result could be similar.
I think you did pretty well too in the past with your IRA.
If you follow a firm very closely and have the discipline and some insight into the field and can understand why a stock is trading where it is and see catalysts ahead that the market is currently ignoring but will very likely be forced to see soon you can do well. It's hard. But one example is a firm that works in an area where I have a graduate degree and I understand the business somewhat and knew that it was ludicrous that it was trading where it was so I went with a sizable position in 2 year call options and the market eventually caught up to me. And I could trade around it as it went up. But you can also make money with other techniques as stocks trade sideways. But this is only for people who really spend the time to make it work. It's a job. And it's often not a fun one.
I think I've taken positions in about 25 stocks in the past few years and did extremely well on one. Very well on 4 others. Made small amounts on most of the rest. I haven't lost anything substantial on anything (even the short positions despite the market generally being unfavorable to shorting anything).
Position sizing is key too. If you have a 10% position and lose it all you can keep going on. And don't use leverage except strategically (the position above was a very high confidence one that I bought calls for).
So it's possible to consistently do well. But only for very unusual people who are very disciplined and put a great deal of time and agony into it.