Neither is Yann (who has since proposed a different architecture / vision which is yet to take off), but my comment was meant to highlight a recent claim from another accomplished researcher in the field.
Right but I’m not talking about claims, I’m talking about arguments. As a robotics engineer running a farming robot project, I am all too aware of the serious differences in computational challenges and dataset availability between text and image data on the web and the kinds of problems that once faces in robotics. LeCun doesn’t just claim LLMs aren’t up to the task, he provides a detailed list of provable shortcomings which I feel overall make for a compelling argument. I’m hopeful that his JEPA may shed some light on possible solutions, but it’s also a fact that one can find issues with proposed engineering solutions even if they don’t have their own better solution. It you say you have a faster than light space engine designed, one wouldn’t need to have their own functional design to show why yours didn’t work (although such expertise is always helpful). And, well, he did invent convolutional neural networks, tho as I say such expertise is not required to raise valid arguments against some proposed solution.
fwiw, I agree with Yann & you (and many others!) on the shortcomings of LLMs (not from a position of authority, but as a matter of opinion).
I meant to counter-balance OP's point in that there are other equally accomplished individuals who aren't swayed by Yann's (and others accelerationists like Andrew Ng) arguments or claims.
