manas96
Joined 3 years ago
Joined 3 years ago
Meaning who decides if an outcome was yes or no? Answers to things like "Who will win the next Best Picture Oscar?" are fairly obvious and binary.
Can we make bets whose answers are not binary yes/no?
What about "Will celebraty X and Y break up?"? Does Polymarket go to X and Y to confirm if they broke up or something :D
Robotics folks probably want speed and accuracy. I'm from the video game industry so I generally look for speed and stability.
Note: This is a loose analogy and recent techniques are already blurring the lines between these axis.
* You could instruct your LLM to interact with a simulator to run experiments and infer behaviour
* You could edit the transformer model and inject spatially relevant data rather than text as is done in above paper
* You could change the architecture to be more condusive for representating a world state. I.e., LeCun's JEPA world model.
* You could further enhance some of the above by using a differentiable physics engine (eg. NVIDIA Newton) to calculate losses directly.
But at the end of the day if a model has any hope to always produce realistic physics, it HAS to learn the laws of nature in some form or other. It looks to me that the next big leap could be achieved by combining the last two approaches.
P.S.: I like discussing such topics. If anyone knows a forum or discord with like-minded people, please let me know :)
As such I always use this prompt as a test: "A video of a jenga brick tower falling over as a brick is removed. The physics of each brick must be realistic."
It gave me a video of where bricks suddenly disapper or morph into others[1]. The linked video is after 2-3 iterations of me insisting on realistic physics. If you are just glancing at this, you would believe it is realistic.
That said this is still very impressive and one more step towards .. IDK what. But I am a bit reasurred that at least my job won't be fully replaced with AI :)
As such you could try to specialize in this area (collision detection, ray queries, rigid body simulation, constraints, solvers, softbody sim, fluid sim etc.). Of course this isn't for everyone as it requires skills and interest in: low level concurrent programming, maths/linear algebra and physical behavior intuition. If you do find these topics fascinating and can demonstrate some ability in them, your skills will certainly be in demand.