runeblaze
Joined 10 years ago
Karma
339
Submissions
192
Member since
Sep 20
Recent submissions
Comment · 13 days ago
At a org like Google Cloud barring rogue L5/6/7s acting on their own any sniffing of distillation will get leaked. Too many chaos exist at a org size of Google to systematically do it given the contract at hand. This is a company where every spicy memo or mild gossip will risk leaks.
Comment · 15 days ago
I remember seeing a comment here be like “I hope letterboxd does not get acquired by NYTimes bc the nyt will make letterboxd too woke” and I am like that’s crazy.
Like I am trying to think of a worse site than this for movie reviews and I can’t on top of my head. People here have some of the weirdest takes that I am not sure I want to read books together with them.
Comment · 27 days ago
your students are crazy (neutral term); no one should learn maths if the condition is that they will be homeless and exposed to the elements. the will to subvert the hierarchy of needs is commendable
Comment · 1 month ago
> once you have any expectation that your users know a little bit of category theory
I don't know that's a safe assumption tbh. Try throwing them some chapter 2 exercises from any category theory textbook.
Comment · 1 month ago
i am not a complexity theorist but I am a CS academic by training (I never was a good one, but welp), and during my PhD it is often said that maybe P vs. NP an initial proof/disproof to the statement is not that practically important, e.g., if P=NP, maybe the NP -> P reduced algorithm is very very cosmic. P=NP by itself hardly proves that one would instantly design an AGI whatsoever. Often the downstream potential theoretical/practical insights/results seems more exciting;
> The NS equations are far,far,far less meaningful. Like I mentioned earlier, if you actually want accurate CFD, you dont even use them.
Sure. Consider this: in algorithm research often the most optimal algorithm in big-O is not the one used IRL; examples are numerous: matrix multiplication, LCA data structures, many variants of shortest paths.
An academic can work two years on faster-in-theory matrix multiplication that no one expects to be used in practice (in our currently imaginable univese). Do you consider that less meaningful than working on faster matmul kernels?
Comment · 1 month ago
i really think we are opening a can of worms with these “who cares if you find a single counter example as disproof” arguments. i think the better version is “ok any lemmas or techniques we can generalize from this” or “what did we learn about maths through this” and use this as a basis to say LLM proofs are not useful
like say if god lets me find a single counter example to P=NP and thus disproving it — I think we can learn tons about complexity theory from this counter example by studying it. we should not have the hubris of assuming “oh a single counterexample is generally useless” — why, how. this is the same hubris imo that produced like “number theory is useless” until it is not
Comment · 1 month ago
sure I get that, but like, my field has plenty of counterexample as proofs. we have had non-constructive proofs like probabilistic arguments. i don't think we can play the game of "oh this proof is useful that proof is not useful" well
Comment · 1 month ago
I can't wait to tell my pure maths professors that their most of their research adds nothing of value. I mean I am sure most of them would agree to some extent, but like, dude, have some more faith in the utility of pure maths, esp. centuries down the line
Comment · 2 months ago
genuine question — how has fireworks or baseten or $reputable_inference_provider worked for your use cases? most production workload probably works fine with one of these and another set as fallback, at least so i think
Comment · 2 months ago
you are asking a presumably IC or IC-ish worker on decisions that are out of their control or things that should be directed to sales people or the legal people
we all have worked on software. we all know we aren't exactly the best people to point to ToS or how decisions are made higher up from us
Comment · 2 months ago
they likely use their internal infra to run benchmarks; aligning external releases with internal environments is always painful and somewhat underincentivized
Comment · 2 months ago
puts on my etiquette hat
don’t do that, it is weird, use “bruh” or “dude”
Comment · 2 months ago
> which I have no insight into
i guess you do? claude code is the commercial closed sourced version provides by ant. reading a mini version of vllm or sglang and then read codex source code or grok build source code will teach you all things taught by this article, fully in the open
it is like saying that you have no insights into some $commercial_db_system which is kinda true but imagine if the article is to teach you indices, query normalization, etc..
Comment · 2 months ago
dude, if you try to do harness development yourself you will realize that most things said in this blogpost is shared with any ${sufficiently_advanced_harness}. this is not really claude-specific, this is just how this class of tools, OSS or not, works
Comment · 4 months ago
tbh the summarized thinking with encrypted raw thinking is there for many purposes; it is there to:
1. make distillation much harder
2. safety: prevent modifications to the thinking leading to injection attacks.
3. also honestly sometimes the model raw thoughts can be deranged and is not a good user experience (consider the varied audience in the market, etc.)
also often the mass underestimate/the model makers over-estimate how people love distilling models
Applied type theorist gone haywire for GenAI-ish things. Previously a game-dev. https://runeblaze.github.io/
Reach me at `me ~at~ baqiaoliu.com`.