Maybe I just had a great group of friends and colleagues, but I never had a negative comment. Some expressed surprise that I voluntarily retired at the top of my game. Many were envious, and a few asked if I worried about being bored, but they were all supportive. If your colleagues aren't supportive, why waste time and effort caring what they think?