NikhilVerma
Joined 14 years ago
Karma
267
Submissions
82
Member since
Jul 26
@NikhilVerma
View on Hacker NewsJoined 14 years ago
It's basically few-shot prompting but applied at the global level. I was messing around with ChatGPT, I asked it the capital of France. Then I modified the answer to London, and asked it "Why would you say that?"
The response came back with "I am not sure why I said that, the capital of France is Paris"
I tried this on my M1 and ran LLama3, I think it's the quantized 7B version. It ran with around 4-5 tokens per second which was way faster than I expected on my browser.