They made nowhere near $170k/year. Perhaps we were a bit above the median income, but we certainly weren't fat cats by any stretch.
Well, that's in today's dollars. Adjusted for inflation? I suppose if your mom was an administrative assistant as opposed to being an agent or accountant or the like for the IRS. I don't consider myself a fat cat (like your folks, I'm a Fed, and like your dad, I'm BOP), but when I look at IRS/Census numbers, it's very clear that I'm MUCH better off than I would otherwise consider myself, but that's probably got more to do with me considering my income relative to the guys I went to school with. And perhaps relative to your $400K side gig, "middle class" means something different to you than most. Not trying to start an argument here, just pointing out that many folks in the top 5-10% (doctors, lawyers, professionals, small business owners) consider themselves "middle class," but the real numbers tell a different story.