Comment

Comment by astrange

People sure like making incorrect statements about LLMs.

> There is no self-reflection of its information; it does not know what it knows and what it does not.

This is a property of the code around the LLM, like the sampling algorithm, not the model itself. You could write this if you wanted to. (It would occasionally be incorrect about what it knows, of course.)

A question almost none of them know the answer to is "what is the line of poem X that comes before the line Y?", because of the reversal curse.

parent astrange 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton