Life and finances can be more unpredictable with young kids. It's easier to figure out when they get older and life settles down a bit more (although college, depending on how you decide to handle it, can be a significant question mark also).
I think going with a recent TTM number is fine. I used trailing six months, and when it came time for me to pull the trigger, the question I asked myself was "Would I be willing to live like I have the last six months?" That is, was my lifestyle the last six months acceptable and had I been spending in a way that I felt was sustainable long term?
I would absolutely recommend some sort of math effort for including the rare large expenses (cars, roofs, HVAC, braces for kids, college for kids). It probably doesn't have to be perfect, but as I'm sure you can see it changes the 25X number a lot.
One final thought - it sounds like you're including the mortgage payment in your 25X expenses number. Your mortgage goes away in 13 years, so it's not perpetual, so it doesn't need to be covered by 25X. To model this a bit more accurately, you can put it in as a spending amount that ends after 13 years in cFIREsim or FIREcalc. Another quick-and-dirty way to do the math is to subtract out your P&I on your mortgage payment from your expenses number, multiply the remaining expenses by 25X, then add in your mortgage balance.