A milkcrate won't be waterproof but it also won't be appealing to people with sticky fingers. I never lock my bike alone outside - it is inside at home and work.
On the other hand the panniers I chose and most others as well can be removed from the bike in a jiffy. The case of my panniers it is simply a few snaps.