It will be okay! Seriously, I just went back to work after 9 years. I worked PT the last couple of years not making much money, but having a very flexible schedule. We, too, are frugal and save, but we have some things coming up (like braces and home repairs) that made me realize that we need more cash on hand especially if we are planning to retire early.
I starting looking months ago, and I finally found the perfect fit. I work 8am to 4pm so my girls only have to be in aftercare for about an hour and a half. Crazy enough - they love it! They are really excited to hang out with friends after school. I was worried about summer, but everything has fallen into place. We hired a baby sitter who has been a gem and we are using the school program as a back-up.
I love my new job and am amazed that they pay me to do what I do. I say just start looking and putting feelers out. You never know what will pop up.