aliljet
Joined 10 years ago
Karma
1,565
Submissions
276
Member since
Feb 22
contact me here: [email protected]
View on Hacker NewsJoined 10 years ago
Perhaps I'm losing touch with the edge, but it doesn't seem like this is quite possible with the hardware baseline I'm talking about...
Now, I happen to believe that's an excellent strategy. I bet they actually resolve more LLM requests than any other company at this point. The lay person still uses Google exclusively.
How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with post-training magic.