A small load may unbalance the machine, as it ends up on one side of the barrel, so the machine wobbles off its centre of gravity. A larger load is spread around the barrel so is less of an issue.
Also, if the machine isn't level, it may vibrate and bounce around. Maybe try adjusting the feet so they are at least all touching the floor, and preferably set to keep the machine level.