It's not the safest thing to do, but a rag soaked in Coleman lantern fuel, left to soak on top of old caulk will remove silicone very effectively. I once removed dozens of feet of old caulk joints from a cheap, used pop camper. It works amazingly well. I don't know if it works as well on other types of caulk.