You are conflating 2 separate but related issues: titles and income.
If I can have a prestigious title in job 1, but I prefer Job 2, which has no prestigious title and both jobs have the same income, then no, IDGAF about my job title or what people think of my work.
More prestigious work does tend to come with higher remuneration though, so the challenge becomes if you will actually be happier doing the job you enjoy more, but being paid less for your time. That's where the trade off starts being very very personal and dependent on your circumstances.
You also have to account that higher paying jobs also often require longer hours and much more intense investment of energy and stress, so there's that trade off of non-monetary assets as well. How valuable is higher income if it's killing you and ruining your marriage? Again, the balance is entirely personal.
Where is starts getting really interesting is when the work you enjoy more actually pays more per hour of time, but pays less overall due to far fewer hours, but gives you more free time. Like a lot of us who do consulting.
So no, the title really really doesn't matter, but that's a lot easier to say for people who have had extremely prestigious job titles and learned the hard way that no one cares as much as we thought they would in our 20s. That "oh wow, your a XYZ" or "oh! You must make a lot of money" is more awkward than cool in real life conversations.
The people who like you don't care about your job title and the people who don't like you don't matter.
If you aren't happy, then there are so many options aside from going back to lower paid, less skilled work. In fact, MORE highly skilled work tends to be a great answer to getting better paid for less stress.
Just look at sol's thread in the Post-FIRE section where he's going back to work just because he was offered so much money to work from home because he had a unique skill set.
The highest paid, chillest professionals are those who can demand whatever kind of work situation they want because their skills are worth whatever bullshit hoops they demand their employers jump through. It takes A LOT of work to get to that level though.
So yeah, if you aren't happy, then definitely change something, but don't get hung up on titles because nobody actually cares except your parents and people who don't like you.