Your reasoning seems sound to me. That said, can we really rule out the possibility that stainless or glass or silicone will have problems found in them? We may have been using (some of) them for hundreds of years, but we haven't been scrutinizing them scientifically for that long.
> That said, can we really rule out the possibility that stainless or glass or silicone will have problems found in them?
No. We can't completely rule out anything, if you ask me.
But, glass and stainless steel have been used in sensitive environments (eg. chemical synthesis) for around a century, so we'd most likely have discovered if harmful substances leak from these materials. It would show up when a substance has been synthesized, and some sort of chromatography/mass spectrometry is performed on the resulting substance.
