albertzeyer
Joined 16 years ago
Joined 16 years ago
https://github.com/albertz/PyCParser/blob/master/demos/disse...
The code seems based on llama.cpp and GGML.
I don't fully understand why it is a standalone project. The readme discusses this: DwarfStar 4 is a small native inference engine specific for DeepSeek V4 Flash. It is intentionally narrow: ...
I think the only bigger difference in DeepSeek V4 vs other models is maybe the type of self-attention. And that leads to: KV cache is actually a first-class disk citizen.
But I still feel like those changes could have been implemented as part of some of the other local engines.
I also assume more models will come out, not just from DeepSeek but also from others, and they might share similar self-attention approaches, that would benefit from a similar KV cache implementation.
> The temperature in Finnish saunas is 80 to 110 °C (176 to 230 °F), usually 80–90 °C (176–194 °F)
And with that temperature, I think 10–15 minutes are pretty standard.
I know many computer science colleagues who were not exposed to programming during that age and only later came to it.
I feel kind of lucky that somewhat randomly I stumbled into computer programming (because XtreeGold could show the content of files, and I was learning to understand BAT-files by looking into them) during that age, and that's what I do now.
There are probably a lot of things you were not exposed during that age, that could have been the perfect match.
There are also lots of kids who just play games, or video games, do sports, watch films or so during that age, without really being exposed to any "potential useful" activities. Some parents would maybe even say that this is how it should be.
As a parent, I guess a good advice would be to try to expose your child to as much things as possible, without forcing it to do anything of course.
[email protected]
http://www.az2000.de
https://github.com/albertz
https://twitter.com/albertzeyer
Research Scientist, PhD; Deep Learning, Speech Recognition, NLP: http://www-i6.informatik.rwth-aachen.de/~zeyer/ https://scholar.google.com/citations?user=qrh5CBEAAAAJ&hl=en
[ my public key: https://keybase.io/albertzeyer; my proof: https://keybase.io/albertzeyer/sigs/1NQp461oCwDiD4vB8HKfiZAkztYALFalSYwHFsnX8IU ]