I have the same issue, I think it's caulk around the border of the shower, but there is something a lot harder inbetween the plastic layers (seems like it's the equivalent of a bath-fitter style piece on the wall. I had tried removing it with my utility blade, but it wasn't effective.
I'd like to know if you make any progress with this!