~5 mile commute, ~10-15 minutes depending on traffic / time.
I go home for lunch a few times a week. Sometimes, I take a bit longer lunch, sometimes shorter and get things done. Sometimes I even go home, make lunch, do some house work, and then bring my lunch back and eat it while I work.
Going home on lunch is wonderful most times, but also makes it hard to want to go back once you sit down and get settled or are working on something.
I would add a few trips into your routine and see how you like it, but +1 from me for stopping home sometimes.
I also would ride my bike in the morning and home for lunch, then shower, eat, and drive back. That's nice, too.