>Vestiges doesn't have any gameplay involving timing like Pong does. I could imagine that sort of gameplay being harder for it to get right.
Thanks. Yeah I think that's the main thing. They can look at pictures (although I've had some amusing results with that, too...), so theoretically they could play a game frame by frame if they run it very slowly. That would just very slow (like 10 minutes per 1 second of gameplay) and very expensive.
But basically, they can't "see video" yet, so they're blind in that domain. They can only see static images, not movement.
I expect this to be solved eventually, either with some new architecture (Google is doing a lot of interesting work in this space), or -- and this is kinda funny -- just running them really fast. The labs are experimenting with specialized hardware (e.g. Cerebras) lately, which can do inference at thousands of tokens per second, and several of them have plans to offer it in the next few weeks.
In other words, I think we're going to get around the "time-blindness" issue, in the short term, by just... running them really fast. (Then it would only take 1 minute per second of gameplay, instead of 10...)
Unfortunately, specialized inference hardware massively increases the per-token costs, as well as the tokens per second, so... it's not going to be a practical option for a little while!
--
Re: Superpowers: Thanks for the tip, that sounds very cool.
Thanks. Yeah I think that's the main thing. They can look at pictures (although I've had some amusing results with that, too...), so theoretically they could play a game frame by frame if they run it very slowly. That would just very slow (like 10 minutes per 1 second of gameplay) and very expensive.
But basically, they can't "see video" yet, so they're blind in that domain. They can only see static images, not movement.
I expect this to be solved eventually, either with some new architecture (Google is doing a lot of interesting work in this space), or -- and this is kinda funny -- just running them really fast. The labs are experimenting with specialized hardware (e.g. Cerebras) lately, which can do inference at thousands of tokens per second, and several of them have plans to offer it in the next few weeks.
In other words, I think we're going to get around the "time-blindness" issue, in the short term, by just... running them really fast. (Then it would only take 1 minute per second of gameplay, instead of 10...)
Unfortunately, specialized inference hardware massively increases the per-token costs, as well as the tokens per second, so... it's not going to be a practical option for a little while!
--
Re: Superpowers: Thanks for the tip, that sounds very cool.