Ha! I almost never set foot in a conventional grocery store. I also do not shop in the town where I live. I head to the next town over where my routine is 99 Only Store, Grocery Outlet across the street and then Costco around the corner. Throw in a Winco trip every other month or so (not close to home), an occasional Farmer's Market foray and I'm set. Recently, I needed one item and went to the conventional grocery store because I was in the same block for another reason. I was damn shocked at the prices! I literally walked around with my mouth open, gasping at the prices.
It is entirely possible to get great stuff for less than "standard" prices without a ton of extra effort. So, if the better prices are found farther from home, embrace it! Plan your big shops around those stores and do it less often. Set up a pantry and learn how to cook from it. Bike or don't bike. It doesn't really matter, because you won't be doing it very often.
Sidebar rant: It cracks me up that the Grocery Outlet receipt says how much you've "saved". Today I spent $36.79 and "saved" $115.93! Like hell I did, but if I'd gone to the traditional grocery store, the same stuff would have been much spendier and I would have brought home a lot fewer groceries.