xnzakg
Joined 11 years ago
Joined 11 years ago
turned out to be a bug in a patch, causing kv cache indices to be stored in too narrow variable types, making them wrap around.
fascinating, and slightly horrifying, that LLMs are able to notice that their output isn't what they meant to output. reminds me of the mirror test.
and skills from building with hand tools help you judge the results, but not necessarily with actually using the tools.
It's the same as age limits on energy drinks, alcohol, tobacco etc. More of an inconvenience than a restriction if someone is determined enough.
We should focus on having parents teach their kids what they should and shouldn't be doing, instead of "blocking" them and pretending that solves the issue.
Source? Can't find any good source on this.
Then you can be writing the code, with the LLM doing the "boring" parts, in chunks small enough you can review them on the fly.
qwen was faster in t/s, but feels like glm spends less tokens thinking and seems better at finding issues, to the point where it ends up being faster.