Everyone always likes to instantly respond credit unions, but I wonder how many of them have actually opened a business checking account and researched options.
When I looked into it, I found credit unions to have significantly fewer options and features and reduced security, all while not being any cheaper. I went with Chase which has been fabulous. In particular, I can cut an unlimited (as far as I'm aware of) checks to places each month for no cost. Chase creates the check and mails it and all I had to do was specify the vendor or contractor and an amount. The one downside of Chase has been the low limits on mobile check deposits (like 10k). I typically invoice monthly so that means each month I'll have to swing by a Chase branch to drop off my check.
I was biased towards Chase because they offer free business checking for Veterans, but if not for that I was still probably going to bank with them or Wells Fargo. Chase is free if you keep a balance of 1500 anyway which is pretty attainable for most people. All the credit unions I talked to were pretty bare bones and left me unimpressed. Doing things to thumb your nose at the "evil big banks" like using credit unions is fine in theory, but not a priority imo when it comes to business checking.