Not really: The Xbox has 320 independent decompression channels according to its marketing material, which is kinda powerful. The PS3 had similar tech in its Motion Decoder, but they didn't disclose how powerful it was.

And even if it had just a single decoder, there's always the possibility to pre-decode audio. Or just decode the music/film.