Comment

Comment by tovej

They do not model the world.

They present a statistical model of an existing corpus of text.

If this existing corpus includes useful information it can regurgitate that.

It cannot, however, synthesize new facts by combining information from this corpus.

The strongest thing you could feasibly claim is that the corpus itself models the world, and that the LLM is a surrogate for that model. But this is not true either. The corpus of human produced text is messy, containing mistakes, contradictions, and propaganda; it has to be interpreted by someone with an actual world model (a human) in order for it to be applied to any scrnario; your typical corpus is also biased towards internet discussions, the english language, and western prejudices.

parent tovej 8 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton