Comment by tsunamifury

I'm sorry, we know exactly how LLMs work, this myth that we "dont know how they work" was perpetuated by executives that dont know how they work.

We know exactly how attention layers work and how they produce the next word as well as draw them from larger feature spaces.