bxff
Joined 4 years ago
Karma
6
Submissions
8
Member since
Nov 28
Joined 4 years ago
> I have had SOTA models do all of the above. Not sure about more or less likely than human code, but since LLMs can generate thousands of lines per hour, that tips the scales.
I'd be willing to wager that SOTA models are far less likely to write harmful code than random human beings. Models are far less likely to make mistakes as they continuously keep getting better, while every human may differ in their abilities at writing 'good' code.
- $19.27 USD - API requests: 7,877 - Tokens: 2,116,598,952
Ok this is a bit of lie, a lot of my tasks are very experimental loops whose 99% output is like rubbish and can work forever continuously and take advantage of that 120x cheaper input cache. Still incredible.