m_ke
Joined 14 years ago
Joined 14 years ago
2. automation of computer work
3. commoditization of "intelligence "
4. collapse of frontier labs
humans will be fine, we'll have rapid progress on anything a human could do on a computer but it will take a really long time to trickle into the real economy
OpenAI and Anthropic are already in a ~200bil hole from previous model iterations and are committing to trillions of additional spending
OpenAI spent more TBPN than kimi spent on training K3
on my dual 3090s qwen 3.5 27b was running at around 110tps using the config from https://github.com/noonghunna/club-3090
make that 200tps on a single 5090, 4x faster than opus https://x.com/radixark/status/2088285681131110446
devs about to get handed a two 5090 box each and told to max that out
It's really tiring to have to tweak everything with each model release and then watch those changes mess up cheaper models in the process.
Now I can't wait for someone to distill K3 into a Qwen 3.6 27b or Poolside S 2.1 sized models for a proper fast local Composer 2.5 replacement.
I'll never get why he thinks China would just sit there and let the US dominate them in AI when all it would take is a few of their boats blockading Taiwan to put a stop to it all.
We had a bunch of things that we never published that ended up being major research findings years later at top conferences.