RandyOrion

At least student movement succeeded in an authoritarian / totalitarian country. The movement was a dangerous move and can be fatal. Please remember that in 1989, Chinese students and workers protested in Tienanmen Square, and got massacred and failed.

At least this parliament is elected by people, not manipulated by a corrupted authoritarian / totalitarian party or such.

At least Serbia society can get a chance to rest or recovery after a lot of destruction happened.

Wish them the best.

I'm aware that long-lasting reverse engineering efforts on nvidia gpus, like cmp gpus, will lead to something impactful. I just didn't see it clearly until your project came out. Good job on that.

For now, I think reverse engineering efforts on 50 series gpus are just beginning. There are projects like reading sensor temperatures directly from the gpu itself instead of using deliberately DOWNGRADED software like nvidia-smi. However, I don't really see these efforts spreading, and people behind them really needs more recognition. Props to these people, too.

As a person who uses consumer level hardware to do neural network research, this unlock is truly INVALUABLE.

This unlock is super useful as it improves the GPU performance on computation-bounded neural network workloads like LLM prefilling, image/video generation, and general neural network training, in a way of disabling deliberate software segmentation on the same hardware imposed by Nvidia.

I'm on rtx 50 series, and no free performance uplifting for now. Waiting for more reverse engineering efforts to reveal whether the unlock is possible for 50 series.

In China, at least 100 million retired people with rural Hukou (户口) can only get 100-300 CNY (or ~15-45 USD) pension per month from the government. Note that they just pay their taxes like everyone else. That's why raising children so they can help you when you're old (养儿防老) is so wide spreading in rural China.

Ask me how I know this? Most (99.999999%) people in China do not have the freedom to express themselves online safely. You meet them and ask them personally to know this kind of thing exists. Then you check the statistics from Chinese government about pension distribution, retired people with rural Hukou get the most discrimination from the government.

Hilarious. My first thought on these fonts is that similar clip art style text is frequently used in Persona 5. Now I know this is an active design choice.

P.S. I saw keming and my mind went blank for a little while.

> I was shown a prompt and told the internal research model had simply been given the problem statement. Levent had been told by Sebastien “very little human input” had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem, that this was one of a number of things that was tried, that work had started on the unforced problem, that the team first set the model on easier problems, including Euler, that even the prompt that had been shown to me had been written by prompting Codex, and that an insane amount of compute had been used.

> I asked when the first prompt had been sent by them. This question was not answered directly by OpenAI for some time. Eventually it was agreed that it had been sent in the past few days, after information about our work had reached OpenAI.

> I asked whether the model had been trained on, or had access to, our sessions in Codex, into which we had been putting all our drafts for the whole of this project. I was told the model did not look up user data. I asked again, about training, and I did not get an answer.

> Two proposals were offered to me. The first was that we post our Euler result, and that OpenAI post its Navier-Stokes result the next day. The second was that, after posting Euler, I alone write a paper presenting the Navier-Stokes result, acknowledging that an internal OpenAI model had resolved it. Sebastien twice asserted that he wanted Levent removed from authorship, and said it would all be simple if only it were not the case that, and it was so annoying that, Levent works at Anthropic. It was also said that if OpenAI posted after us, they would say that we deserved the Clay Prize, and that we were the “closest humans to the problem”. I declined both offers.

> I said that if OpenAI released its result in the way proposed I would go public with what happened. The reply was, “Why would you ruin your career?” I replied that I am an academic, and asked why he thought going public would ruin my career. The reply was, “If you don’t want me to be nice, then I don’t have to be nice.”

Wow, that's some VERY friendly communication. Besides, will the career of the person be ruined because of “Why would you ruin your career?” came out of his or her own mouth?

For people who want to quantize kv caches for longer context, basically, if the model checkpoint you use didn't trained to use quantized kv caches (and all most all of model checkpoints you can access didn't), you shouldn't quantize kv caches during inference. A major benefit to do quantization-aware training/distillation on official checkpoints is to let the model to be familiar with quantized activations/weights/kv caches.

Thank you Qwen team for this release.

Compared to closed weight (especially unreleased and access-limited) and open weight/source large sparse MoE LLMs/VLMs, open weight/source small dense models benefits public the most because they just reaches more people.

Compared to Qwen 3.6, 3.8's thinking style changed drastically. With xhigh budget, it thinks a lot MORE, and longer thinking session directly translates to better performance. This tradeoff between performance and computation, memory, etc. is meaningful to me.

However, because Qwen 3.6 and 3.8 share the same architecture, with 32GB vram, llama.cpp, IQ4_XS model, MTP and FP16 mmproj, I can only get 200k context, which is not good compared to 640k context of muse glimmer. Hopefully this problem will be solved in Qwen 4.0 release.

Thanks Bonsai team.

Now open weight LLMs/VLMs/LMMs are becoming even larger to the extent that consumer-grade hardware are no longer able to run these models. In contrast, quantization and pruning make the model better at the size-performance pareto and provide people with strictly more possibilities.

Other details for the official (Yang Youlin) in this news.

---

Whistleblower Yang Hai already reported Yang Youlin for his economic misconduct in July 2008. The whistleblower was detained because of the report at Nov 21st, 2008.

---

People's comment on this matter around March, 2009:

哇塞！终于有人敢动杨友林啦，杨海好样的。杨友林此人早该除无奈碍于他的势力。除掉杨友林大快人心。Wow! Finally, someone dares to take action against Yang Youlin. Good job, Yang Hai. That guy should have been dealt with long ago, but we were stuck with his influence. Getting rid of him is incredibly satisfying.

不杀此贪官，难平民愤。If you don't execute this corrupt official, you won't appease the public's anger.

江宁有一个传说，谁也动不了杨永林！There's a legend in Jiangning: nobody can touch Yang Youlin!

他的保护伞是谁？Who is protecting him?

希望引起中央的重视！I hope this gets the attention of the central government!

现在社会怎么啦？好多天了根本没人关注这件事？是上层没有看到？还是视而不见？还是怕牵连自己？What's going on with society lately? It's been days and no one is paying attention to this! Did the higher-ups miss it? Are they turning a blind eye? Or are they just afraid of getting dragged into it?

---

Since the report, there were several pieces of news about "the investigation about Yang Youlin is ongoing", but no real progress until 2023.