nuc1e0n
Joined 6 years ago
Joined 6 years ago
If you don't point out what's wrong I find the LLM will go into great technical detail which consumes a lot of tokens, but not 'see the wood for the trees'.
It seems to me human beings also have mechanisms to compact context, which may be why we can forget what we came into a room for when going through doorways. I think it would be interesting to research which markers we use to compartmentalize our thinking.
Was it being sold as the latter? I thought it was strange that a fuss was being made over this tech demo, and that explains why.
Parsing regular languages into other regular languages is exactly what transformer based LLMs should be good at.
A while ago there was an AI system publisized that was trained to generate animations from the game doom that was sold as AI created computer games. But the output made no sense if you watched for more than a few seconds. Isn't this the same kind of scare tactics dressed up as innovation?
https://news.ycombinator.com/item?id=49731285
It seems LLMs are better at writing SQL queries than doing the data summarizations themselves. Makes sense as SQL queries occupy much less space in a context window.