wild_egg
Joined 3 years ago
Joined 3 years ago
Weird. I distinctly remember Commodore 64, DOS, and Windows 3.1 at school. Kind of hard to use Windows 95 before 1995, but I am pretty sure I had a Windows 98 SE machine at home when my school finally got Windows 95.
LLMs work on tokens. They literally cannot see individual letters. Yet, unlike humans, they can instantly create a tool to solve this task for them and never be stumped by it again.
I'm so tired of this brain-dead gotcha comment.
For me the cool bit is that it's all in-context learning or whatever so you can use it in any domain with zero setup.
Maybe bert and co. could do all the same things before, but the way in which you use them is quite different and that helps a lot.
I was very excited last year for their coding plan but seeing a burst of requests pulse and then sitting there watching the cooldown reset is really not a great time.
Even though each individual request was fast, the sessions were only maybe 10% faster on wall clock time since there was so much waiting time.
Again, we are not talking about agents or your Python API script but instead talking about exploitable flaws within the inference engine itself. It wouldn't output `rm -rf`. It would output literal CPU instructions that llama.cpp would start executing directly. The payload would never get back to your Python script.
> Will we converge on a bug free state?
I have never witnessed this state in my two decades of software work. Why would we think AI will magically achieve this?