nxtfari

Karpathy also. CS231n first came out in 2015.

Given that Google is the named partner, it’s almost certainly Gemini. Also would make sense, Gemini’s (only, lol) strength is search grounded responses.

I was so excited to read this, get an inside view of how this problem must actually be much more nuanced than it seems for some reason not observable from the outside, just to read 10k words of whining and pleas for sympathy. When he finally makes it to the technical section it’s just “it’s a lab culture, there’s a lot going on.” There were some extremely inexcusable mistakes made apparent to anyone who knows anything about security at all. If the lab is spinning off experiments faster than you can improve your security posture just say that and own up to it (it’s what he appears to be trying to say in the worlds most mealy-mouthed way).

What you say is true, and Moonshot definitely has an agreement with Fireworks, but it still just feels wrong. It’s not the America I grew up in, where if you took, you gave back. I know that’s not a very coherent and practical position, but it feels true to me.

The more I learn about Fireworks the more unsavory they seem as a company. I don’t care what the license says, Moonshot has been openly improving, sharing research, and providing weights for the models that make up your entire bottom line, and the moment you can improve them in reciprocal it’s closed weights, “this is our own proprietary” nonsense? Where are we that China has better open source ethos than America?

Haha this did help me generate empathy for the assistant. Neat idea.

They do have robotics, it’s just not as far along yet as you might expect looking at their progress in other domains. Look at Figure and Gemini Robotics for good examples of SOTA. They’re impressive, but not ready to be in the streets quite yet, I would guess one more year.

> Privacy preservation: an outside observer cannot determine whether any pair of reference images were taken by the same device. Image contents are not exposed to Apple or anyone else.

I am curious if the PCC processing makes it resilient to the method from a couple years ago of fingerprinting the microdistortions in an individual phone lens to tell when two photos were taken by the same phone.

We’re reaching quadratic slop. Slop projects that don’t understand what they’re shipping built on top of slop projects that also don’t understand what they’re shipping. Magnificent.

Good feature but god I hate there’s a whole new keyword for a minor modification on an existing concept. Very unnecessary.

As the saying goes every 5 minutes in Silicon Valley another company reinvents ROS

Agree, I remember when even half precision made its way into C# sometime around 2020 (I didn’t know much about ML then) and I thought, well I guess that’s a worthwhile tradeoff but I can’t imagine going lower. Lo and behold (1-bit Bonsai) how much lower you could go.

Sure, then you should allow that they are also tools for transforming sequences of questions into answers. Language models are based on compression of information, using them as a knowledge base is entirely within capability.

Surprisingly incoherent for Anthropic and Dario (cue peanut gallery — “always has been!” No, I don’t think so. I think this is new).

It seems to me like there is just no good answer to how one could possibly stop open weight models from being used for nefarious purposes. How are you going to enforce guardrails on open source? The only way is to turn the USA into a 1984-type totalitarian surveillance state (even more so than it is). Unable to say that, we just get this floundering instead. How long is not giving them chips going to slow them down? Until we RSI? Then what? Just because RSI runs off the exponential doesn’t mean that the eventual open-weight Moonshot Mythos won’t be able to make bioweapons. Genuinely what is the endgame.

They must have done the math to show even if you peg Kimi K3 generating 24 hours a day for an entire month it doesn’t exceed 10k in opex? Very interesting.