Yes, you are worrying needlessly.
Short with screwdriver and be done with it. The capacitor stores energy and with the system turned off, if charged, the capacitor is the voltage source. When you short it, the source is gone. Sending voltage into other components is not a thing.