I have no love lost for CDs, but I still buy Vinyl, and the best thing about Vinyl is that the majority of new albums also come with a digital download, best of both worlds. At home I listen to the Vinyl for the experience but on the go I have my phone with MP3s that no one can touch but me.
I do the same thing, trying to buy most new stuff on vinyl that has the digital downloads. I also have a ton of older records - Opera and Jazz mostly. I also have a large collection of 80s New Wave / Dance 12 inch remixes, most of which you cannot find digitally. The Recordman in Redwood City, CA is a good place to find stuff.
