> but I also assume that there is very little training data available for Smalltalk.
Is this actually an issue? I was under the impression that the conclusion was that LLMs will invariably be terrible at writing good, working code (since their training sets are 90% garbage produced by humans), hence why agentic development now is heavy on verification tools and other software that can signal to the LLM whether the code works and has any code smells. Also why AI agents nowadays seem to write and execute scripts for a lot of tasks instead of spitting code directly. Hence, the volume of training data shouldn't be as relevant as it used to be.
Is this actually an issue? I was under the impression that the conclusion was that LLMs will invariably be terrible at writing good, working code (since their training sets are 90% garbage produced by humans), hence why agentic development now is heavy on verification tools and other software that can signal to the LLM whether the code works and has any code smells. Also why AI agents nowadays seem to write and execute scripts for a lot of tasks instead of spitting code directly. Hence, the volume of training data shouldn't be as relevant as it used to be.