I understand your desire to have a low mortgage, which essentially functions as a hedge against job loss.
If you put all of it into the home, how many years would it take for you to be entirely mortgage free? You need to provide concrete numbers how much a home costs in your region. This will influence the advice people give you.
If the 100K would give you a super low mortgage which would enable you to prepay fairly quickly, then I recommend dropping all of it in the house. If not, hedge your bets and invest some in a new house and some in the market. But then be sure your mortgage is low enough for you to pay it on part-time wages (to spend more time with your family) or minimum wage jobs (in the event of job loss).
Hope this helps.