Comment by ogogmad

Which things can be embedded as low-dimensional vectors?

[edit]

How exactly might these be used in LLMs? Personally, I know of Word2Vec, but I don't see its relevance to LLMs like GPT.