jameshart
Joined 15 years ago
Joined 15 years ago
Well prompted LLMs with appropriate tools can do exactly what OP asked for. So AI can do this. That the AI-based products people are being given don’t is not a limitation of AI, it is a failure of humans.
Consider a shared or cloud hosting scenario for example.
‘It’s in the dataset’ sort of implies ‘the model is just reproducing output it was trained on’.
In this case you’re saying ‘the model is repeating tasks it was trained to do’
That’s the difference between accusing someone of just regurgitating something they read, vs praising them for having prepared well for an exam.
Reinforcement learning doesn’t work by training an LLM on a series of inputs like ‘rewrite python in befunge’ paired with a prepared model implementation. It doesn’t matter if an open source implementation was in the dataset that trained the language model. All it got from that was an appreciation for syntax and language idiom; when it is generating code it’s doing so according to the approaches and patterns that it’s been reinforced into following in the context of a coding prompt - regurgitating existing codebases is undesirable so it is a behavior it will have been reinforced against.
Did people used to get like this about pocket calculators or digital watches? “Why am I forced to be limited to only the manufacturer’s firmware?”
Only I got the impression the Code is more what you'd call guidelines than actual rules