wangii

I'm surprised nobody mention ELO yet. We used it since 2023.

Java spent decades making pointer-rich identity semantics cheaper, before increasingly recognizing that many things programmers call “objects” are actually values.

We may spend a decade making persistent token-level KV state cheaper, before recognizing that much of what we call “context” should actually be transient, compressed, reconstructed, or represented in an entirely different state space.

KV cache risks turning an optimization of today's representation of history into tomorrow's semantics of memory.

is kvcache a prematural optimization?

yep, deepseek

`harness` is a term invented/borrowed to describe a vague vision of applying llm in a more controlled manner, suitable for semi organized, complex work. the sad part is then people shift the attention from the real problem but seeking inspiration from the terminology.

the real problem: is there a general framework to allow llm with limited context size to approach problems, just like a capable newbie integrated into a chaotic code base? how does it work?

I think it's an epistemic problem, and my fork of pi: pie (github.com/wangii/pie)

yep, that's my first thought came to my mind as well. it's a great talk fueled with the passion of engineer, especially relevant in the era of LLM.

good observation! however, I'd argue it's the distribution channel and installation friction did the job in the cases you mentioned.

given how easy it's to replace LLM API in claude code, and how easy it is to write a claude code clone with itself (Fable is pretty good!), the collapse is coming.

Ted Chiang is a great Sci-Fi author, but his remark `GPT-3 and similar models as a "blurry JPEG of the Web"` was misleading at the best.

I share the view with others the term `consciousness` is not well-define yet, therefore his assessment is pointless. Maybe the real question to ask, if consciousness is merely an illusion at the macro level, when the observers not looking at the tech/implementation level deep enough, just like the term "intelligence" itself, might be more precisely captured by drifting amongst high dimensional manifold pitches.

The idea of software developers' job is to translate specification into codes is dying. Now what I'm experimenting is to make my developers into competing project manager and developers are replaced by AI. I think the key advantages of developers, junior or senior, are the process + data oriented style of thinking, therefore way ahead of people from many other domain.

I told my developers: the day of making good money by sitting in front of computer and typing is long gone. Go to the clients' scenes and build the whole thing from scratch, with some assistant from sales and domain experts. Now you are the PM.