_jayhack_
Joined 9 years ago
Karma
303
Submissions
75
Member since
Mar 19
https://github.com/jayhack
View on Hacker NewsRecent submissions
Comment · 23 days ago
Enterprise is not freaking out because DeepSeek 4.1 Flash does not actually occupy a spot on the Pareto frontier for non-coding enterprise workflows. We see this at my employer, focused on non-technical knowledge work. Luna 6 and now Haiku 5.5 are both very competitive if not better on all axes that we care about
Comment · 1 month ago
Letting a model manage its own context is very bitter lesson-pilled
Biggest challenge is you will get a much lower cache hit rate if you frequently edit the agent's context/prefix, so this can not be implemented efficiently via e.g. the Anthropic API.
This ^ can be solved in principle but likely requires modifications to the transformer architecture and definitely to serving infrastructure
See related: "KV Cache Rules Everything Around Me": https://www.completeskeptic.com/p/kv-cache-rules-everything-...
Comment · 1 month ago
Shocking to me how little interest the general public has in mechinterp given the alien capabilities demonstrated by LLMs - this and the subsequent transformer-circuits.pub publications will be seen as classic, foundational work in a few years
Comment · 2 months ago
Likely from Palmer Luckey, who coined the term 'Chinese instruction manuals'
Comment · 3 months ago
Only the ones that beat expectations
Comment · 3 months ago
formal verifiability e.g. vi Lean
Comment · 4 months ago
The content on "priming" (significant pillar of the book) has collapsed as part of the reproducibility crisis in psychology. More here: https://replicationindex.com/2017/02/02/reconstruction-of-a-...
Comment · 5 months ago
Deep Learning is a Black Box and Here's Why You Should Use Random Forests Because They Are Interpretable
This was the mantra of applied machine learning c. 2010 - 2024 for anyone paying attention. No longer the case.
Comment · 5 months ago
For some definitions of better, yes. Chinese is more token efficient for representing fixed text, for example, although this does not always lead to better performance on downstream tasks.
Comment · 5 months ago
As the author - this was adapted from a thread posted on X in March (linked in article). AI did the adaptation, I wrote the original article. It seems like it inserted grammatically correct hyphens, otherwise the copy is mine.