To me, there is a difference between "going on holiday" and "taking a holiday" and "traveling".
I define "take a holiday" as "being away from work". We absolutely take holidays, especially when DD is also on holiday from school. That does not necessarily mean that we "go on holiday/travel" during the time. Most of the time, we take time off work but do not travel. Instead we putter around the house and visit local destinations like local parks and restaurants. Where we live, it's a terrible idea to travel during national holidays, as the train stations and airports are typically packed with people.
We also have created a home that is relaxing, peaceful, quiet, and comfortable, so we don't actually want to leave home very much. DD's favorite thing is to lounge in bed and read a book (she gets that from her parents).
The other thing we do is visit our parents, but again, we make that as comfortable as possible. We purchased a cottage, so the only traveling we do is up to our cottage.
For us, being on vacation is about rest and rejuvenation, and no one has ever made fun of us or not gotten it when we tell them we're going to hang out at home for a staycation, or we're going to the cottage for some peace and quiet. They also tend to be quite receptive when we invite them to our cottage for their own R&R experience.