I use fidelity for 99% of my banking. My paycheck is direct deposited there. I can write checks, use an ATM for free, online bill pay, check deposit via cellphone app). I move money from the fidelity Money Management Account to my fidelity brokerage account to buy index funds. Can do that very easily with a few clicks of my mouse or on my phone. My IRAs are there, so I can fund those periodically directly from my MMA account. (BTW, the MMA account is pretty unneccessary, because you can do all of the above with a fidelity Brokerage account).
But...the only thing so far I haven't been able to do via fidelity is cash deposits. We've been downsizing and selling a lot of clutter. I've got about $900 cash right now, so I deposit that to my local credit union who offers a free savings account with 5.0% interest on the first $2500. That gets deposited there, and when that amount is too high, I just get them to write me a cashiers check and I deposit that electronically into my MMA.