Chio
Joined 9 years ago
Joined 9 years ago
> With RL, DeepSeek-R1-Zero naturally emerged with numerous powerful and interesting reasoning behaviors. However, DeepSeek-R1-Zero encounters challenges such as endless repetition, poor readability, and language mixing.
A lot of these we can probably solve, but as other have pointed out we want a model that humans can converse with, not an AI for the purpose of other AI.
That said, it seems like a promising area of research:
> DeepSeek-R1-Zero demonstrates capabilities such as self-verification, reflection, and generating long CoTs, marking a significant milestone for the research community.
Maybe it would be better to post this repository as a reference / teaching implementation of HNSW.
Thanks for being a great community.
¹ defining what is a cost vs benefit (and how much) is probably the hardest part, maybe after acquiring the necessary data.
In regard to refactors, people tend to just squash them into another change they are making. This makes the git log a bit harder to follow at times, but people did this back when we just used to push to trunk too so I don't think the story is the deciding factor.
Apps that I would recommend however are many of the apps that tries to gamify physical activity. I use Garmin, but I am not sure if the app works without owning the accompanying smart watches and there are plenty of alternatives, and the gamification and accountability that it offers around physical activity makes it a lot easier to get out of the door (which is always the hard part). Physical activity has long been known to have a huge positive effect on mental capacity and health so well worth spending an hour or so every day on.
Doesn't have much practical application unfortunately since there is almost zero support for things like eytzinger layout in most standard libraries and sorting an array with a eytzinger layout is a bit harder than a non-decreasing layout.
[1] "ARRAY LAYOUTS FOR COMPARISON-BASED SEARCHING", Paul-Virak Khuong and Pat Morin, https://arxiv.org/ftp/arxiv/papers/1509/1509.05053.pdf
If you look at Rust from this perspective then it becomes much more valuable to consider learning because it teach you a different way to modelling your data, and how to break-up your code; and while a language like Java may not force you to consider the borrow checker you will probably be a better overall Engineer knowing how to make it happy even when working in other languages.
On the topic discussed in the actual article: I can't wait for scoped threads to finally go stable since being forced for throw an Arc around almost everything you want to share between threads does not really suit Rust which really emphasise zero-copy in their standard library.
https://highs.dev/ https://www.scipopt.org/