Honestly, if I had to deal with paper bills I'd probably never get it right. I turned off paper bills for everything that can have them turned off. I still check my mail every day, but it is almost all junk.
I have exactly one bill (city water bill) that can't be automated through my bank's bill pay. Not coincidentally, I have exactly one bill that I occasionally forget to pay on time.
Do you intentionally not pay it immediately? I find that just paying things immediately when it shows up works for me.
I do automate things too. But also can't with my water bill. My bill is only $5/mo so I pay about 2 years in advance. Then I make a joke about complaining about the water bill every month to DW. "WHAT? It went up 10% this month!?!?!?"
Sometimes, it's not convenient for me to get on my bank's website immediately after getting the mail. When that happens, the bill goes into the pile of papers on my desk and occasionally gets forgotten. Yes, I should be more organized, but that's just not something that comes easily for me.
By the way, the City of Atlanta is not like the rest of Metro Atlanta, where you live. My water bill is either $50 or $69, depending on whether I use 3 or 4 CCFs [hundred cubic feet] that month. (Incidentally, the average household in the city uses about 8 CCFs/month -- considering that the cost per CCF goes up when you use more, I don't even want to think about how much most people are paying!)