Now that you know it's there you could always just clean up the mess and keep an eye on it. You should be able to tell in a ride or two where it's coming from, and if the new pipe is in fact made out of tin-foil you'll have plenty of reason to take it off and have a look.
Then again, PV gaskets are cheap ... why not just slide one on right now?