HighGoldstein
Joined 2 years ago
Karma
298
Submissions
127
Member since
Jul 13
Joined 2 years ago
Truly a developer mindset.
Wasn't this the utopian ideal of the Star Trek Universal Translator? Is it good when Gene Roddenbery writes it as utopian sci-fi, but bad when the AI people make it a reality?
Apparently quite a bit as long as you're not indiscriminately feeding random slop back in. An AI-generated artifact deemed "high quality" or somehow desirable by humans is a good training input depending on what you're trying to do. Humans don't train exclusively on external inputs either.
Source? The fact that it's not infallible doesn't mean that it's ineffective.
Is this actually an issue? I was under the impression that the conclusion was that LLMs will invariably be terrible at writing good, working code (since their training sets are 90% garbage produced by humans), hence why agentic development now is heavy on verification tools and other software that can signal to the LLM whether the code works and has any code smells. Also why AI agents nowadays seem to write and execute scripts for a lot of tasks instead of spitting code directly. Hence, the volume of training data shouldn't be as relevant as it used to be.