I often get a similar feeling about the yeasts when I'm making bread ;)

And yeah, I can totally taste the flavour difference between glass, plastic, and metal containers. I don't usually mind it with soda, but I really don't like bottled water because of the plastic taste.