LeCun is for sure a source of inspiration, and I think he has a fair critique that still holds true despite what people think when they see reasoning models in action. But I don't think like him that autoregressive models are a doomed path or whatever. I just like to question things (and don't have absolute answers).
I-JEPA and V-JEPA have recently shown promising results as well.
I-JEPA and V-JEPA have recently shown promising results as well.