Comment

Comment by thebeardisred

Wild. if I'm reading this correctly it's effectively a sort of "zip" algorithm for both the inputs and outputs of a prompt based model. thus, it allows a user to compress their request down to the minimal token size which retains the same semantics. In effect, this then allows a user to encode a more dense set of tokens into the original request.

Does that sound about right?

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton