Something to think about that I don't really ever hear mentioned from the people in the don't pay off a mortgage camp:
Sometime in your life you may have a big crisis that affects every aspect of your life and in those cases, having a paid off car and house will be a blessing. Some people may argue that you can always sell the house if needed, or liquidate investments - but if you are in crisis, you will most likely not be up to doing either. It is unrealistic to think you can move in a crisis unless you absolutely have to.
I speak from experience on this, in July my 13 year old son was diagnosed with cancer. Our expenses went up, income went way down (I stopped working to care for him). The month my son was diagnosed we paid every single bill late (first time in 25 years), there is no way we could have time or energy to liquidate an investment. We still have a mortgage payment, but it is fairly low - mostly due to overpaying the mortgage for years and well thought out refinances. I wish it was nothing so that we would have more money right now. We are lucky that contributing to FI was the largest expense we had, and therefore the easiest to roll back. Debt is an anchor that holds you down, period. When you are already drowning, it makes it that much worse.