BenoitP

And now we're all witnessing a major caveat of LLMs: the burden of verification is pushed to the reviewers, while the proposer will get all credit.

Average user input quality is not optimal by definition. SO's upvote system and reputation system is what really refined quality. Much like Reddit's system is helping a lot for conversation. Much like academia's publish and citation system is an even better system.

I'm not saying LLM won't be able to train further, but tough and sound reviews are paramount to improving the corpus of quality content. And with the replacement of SO by LLMs, one can wonder if one quality system went down the drain. Anyway there's still code reviews on GitHub and in private repos, but we're still far from getting the human judgement out of the loop.

Oil is sky high, a recession might be near. Also, optimizations (like the current KV one) can yield a drastic reduction in RAM needs. It's a risk.

If I was trying so stabilize (just stabilize) funding for humongously expensive fabs: I'd be giving markets reassurances that my business will continue to be high margins for the mid-future.

What an eerie feeling reading this, or was it prescient?:

"""

    def fizz_buzz_encode(i):
        if   i % 15 == 0: return np.array([0, 0, 0, 1])
        elif i % 5  == 0: return np.array([0, 0, 1, 0])
        elif i % 3  == 0: return np.array([0, 1, 0, 0])
        else:             return np.array([1, 0, 0, 0])

interviewer: OK, that's probably enough.

me: That's enough setup, you're exactly right. [<--- !!] [...]

"""

Damn, Claude was there all along

There's even a load-bearing in there as well

And GLM local models can eat Anthropic's lunch just like both eat OpenAI's.

Mistral's revenue is mostly B2B, and that's much more difficult to move.

Haha :)

Well, that was the joke. If you're reading this, hi Ron!

It helps you spend more token, is more expensive, and thus is obviously more AI. Also novelty and more complexity means less scrutiny of the approach.

These are necessary and perfectly sufficient for an investment firm thesis I believe.

> That has not been the case, and I no longer think that it will be. People get by with the existing programming languages and models, that seems to be fine.

.. as long as the processing they do fits in a map().

I still deeply believe that a new class of programs can be unlocked by using reduce() or all_gather() in a massive concurrent stream.

In a stadium, why can't a uuid be embedded as an acoustic chirp emitted by all the smartphones, then triangulation-reduced in a 3D map of all devices, enabling a stadium-wide sound system?

Why don't we have MMORPGs that can deal with 100k users in a single game instance?