I grew up with one parent who worked and saved, who was very Swiss (extreme mustacian) and a mom who was Irish and loved to be open and enjoy life. It was a very difficult issue between them about spending and saving, and I thought for a long time that my dad felt actual physical pain when he spent money that he didn't feel like spending. He does have an expensive hobby and doesn't seem to have a problem spending on that, but he'd take his clothes to the gym in a trash bag. There was a serious level of embarrassment there, and he was a wee bit too hard on my mom for use of the measely $300 he gave her every two weeks (in the 90's, and that money was supposed to cover anything the family or home needed, which simply was not possible). He is retired now, paid cash for their house, cash for his regular truck and cash for his hobby truck... and granted, he met his goal of not being a burden on anyone in his old age and not having to sacrifice his way of living. But with this in mind, he has OVER a million dollars in investments and doesn't even have to live on the interest, he lives on the social security checks they both get. Sure, he met his goal, but he was a shit head while he was reaching it.
For me, I'm glad I can see both sides of this coin. I too feel physical pain, funny, but no joke, spending money on certain things, but I try hard to keep the emotion out of it. I'm remarried to a man who is not only frugal but he can fix ANYTHING. What I do to keep my sanity about money, I give myself $200 a month to wipe my butt with, and if I don't wipe my butt with it, I'm wrong. I make $4000 monthly after taxes and easily put away $1000 monthly into savings. My only debt is my car and that's about to be sold. So, in order to keep my mental health in check and not end up a stingy jackass like my dad, I make myself spend $200 on fun stuff monthly. I could waste more, but for now, this is what I do.
I'll say this, too, one of my hobbies is charity work, and I have a secret goal (sure I'll share here, since this is kind of a full disclaimer) but I am happy to keep my bills down and stay at an overpaying job just so I can give more money to people who need it. Strange reason to want to keep working, maybe, but I feel mustacianism can lead to OCD and greed, so I am sure to keep an eye on myself there. I know someone who wants to stop working very early in life, very frugal to the point of being stingy and cheap, and I do not believe that human has ever helped another soul in their life - what is the point of that??
So yes, its emotional, but its worth keeping an eye on so you don't alienate yourself or cause marrital problems. Its a very fine line, definitely.