Yeah...total non issue for me.
I loved my job, I mean LOVED my job, and when I was forced to retire, I spent the first year desperately trying to figure out what to replace it with that I could physically do.
Now? I'm super chill, my life filled up with all sorts of other cool stuff over time and I have plenty of meaning. I'll probably pick up some work eventually because it's inevitable that some of the projects I want to do will involve doing very valuable work, I'm constantly being offered jobs, but not for a lack of purpose, and definitely not for a lack of wellbeing.
I'm mentally and physically better off than I've been in years.
So just like frugality, if it hurts to have more free time, then you're doing it wrong, and you probably need some fucking therapy. Seriously.