Comment

Comment by tracerbulletx

This doesn't change the point of your answer, but to add on, the result of that learned function is the probability of all tokens occurring next which is sampled when inference is happening. The type of sampling used can be different at inference time.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton