Comment by moonu

I like the demos on your landing page, quite fun. I don't think I've seen VLMs used in this kind of real-time context outside of robotics before. I feel like the actual ideas behind JEPA make a lot of sense for increasing sample efficiency and is probably a lot closer to how our own brains work (considering that people with aphantasia or those that lack an internal monologue still function just fine).