Speaking only for myself here...
We agonized over whether or not to do this for months. We did extensive analyses on other investment potential, etc. I even emailed Mr. Money Mustache himself about it and he kindly wrote back!
We paid off the house. We have never, ever, ever regretted it, for a second. It is the best feeling to know we paid none of that interest, and are secure as long as we can pay our (fixed) property taxes. We DID have other savings, so we did not clean ourselves out, but we have never regretted a house, free and clear, FOREVER.