Hi Rylito
I have panniers on my bike and they are an amazingly efficient way of carrying large loads. In fact I finally sold my car when I discovered I could carry a case of beer in two panniers!
I use Ortlieb Panniers matched with a Tubus rack. These are both expensive German brands of equipment but they are designed really well (well, expensive in Australia, possible cheaper in the US). They are water proof with a very quick but secure attachment system that is designed to go together.
Because the weight is on the bike it makes handling a little less responsive, but it takes all the weight off your back so although you feel like you are driving a less responsive bike, you feel very free! I personally don't mind the impact on the bike handling. And I love having a backpackless back in summer.
The panniers on the back of the bike make the bike considerably heavier and more difficult to carry when attached however. I did spend a year carrying the bike, with pannier, up three flights of stairs to work but I did it as a pointless physical challenge to myself. So its not impossible.
On the plus side, the Ortlieb panniers can very easily be clipped off and carried via a shoulder strap to lift the bike without the additional weight. Other pannier bags may have similar attachments.
Do you know how heavy your bike is? I find the weight of the bike isn't always the problem, but its the way the weight is distributed awkwardly across a unwieldy bike. In any event, my bike (a steel surly cross check) is about 11kgs without panniers, and sometimes 15kgs+ with panniers, or 24 and 33 pounds.
Interestingly a case of beer (24 x bottles) weighs around 15kg. So heavier than the bike that is carrying it!!
I don't notice the uneven weight distribution when only having one pannier loaded. But often I have both pannier bags running with them half full, as i never know what I'll buy at the supermarket. You'll most typically find they are sold in pairs anyway and the second bag does come in handy sometimes.