I use to handle plan rollovers for a fairly large investment firm so I got to see what everyone was doing.
Here is my rule of thumb in the 401(k) world(occasionally wrong, MetLife proved me wrong once, but right most of the time):
Best: Vanguard institutional negotiated plans. aka Google's 401(k) plan. ERs as low as 0.01% with other perks like access to a CFP. I am not a programmer, but I so wish I could have my money in Google's 401(k) plan!
Great: Standard Vanguard plans, Schwab, TIAA, low cost Fidelity plans. Costs in the 0.05-0.5% range.
Middle: no one. It goes straight from great to crap.
Crappy: Big banks, big investment firms, active mutual fund companies, and record keeping firms. Wells Fargo, JP Morgan, Merrill Lynch, American Funds, ADP, higher cost Fidelity plans, etc. Costs in the 0.5-1.5% range.
Terrible: Expensive active mutual fund companies and high cost brokerage firms. Edward Jones, Raymond James, Oppenheimer. Costs 1-2%.
Scum of the Earth: Mostly insurance companies. These are the only plans I ever saw where the average fund had an ER over 2%, and I only saw one where the ERs were under 1%. That was the time MetLife surprised me.
Standard is an insurance company. There is my opinion.
Follow all of the advice given so far. Get the match, then start maxing out every other tax deferred option before adding another penny to this 401(k). Now I would still contribute to this 401(k) before contributing to a taxable account. Tax deferred is still tax deferred.
Side question, how big is this company? Many companies have been sued the past few years by their own employees for not negotiating 401(k) benefits as well as they could. Those admin fees are extremely high. The Vanguard 500 index fund should not cost 1% under any circumstances. If the 401(k) has more than 2 million in total assets they need to shop around. I know they can do better if they make a few phone calls. Even if they have less than 2 million in assets they should still shop around, but they might not be able to do too much better.