We limit dining out mainly to when other people treat us! The inlaws visit a few times a year and they typically treat us to a meal out but with two small children, the last few visits we have opted for take out instead.
On the rare occasion (maybe 2x per year) we eat out of our own accord( because we have a gift card typically), it's usually early bird breakfast at a family breakfast joint where it's quieter and cheaper.
I agree with others that with little kids, dining out is so much work between keeping the kids amused as you wait, remembering to take kid safe utensils/bowls, picking up dropped food, dealing with crap high chairs with broken straps etc.
If we had a sitter, we might in theory go for a meal occasionally as a couple, but add in the cost of the sitter and I just can't accept the total cost for a meal that I can make at home. Eating out isn't just about the food but relative to the experience gain, I don't feel it's good value most of the time. When the kids are older we will probably venture out a little more.