lubesGordi

I like the dot com bubble comparisons mainly so that I can look at the differences. That is where the information is, and it's what you want if you're going to navigate this market.

As a senior, I do the same.

Sim racing is at least kind of like that.

When you say its very very hard to create a good splat, what do you mean? And what is good? I would say that strawberry is very detailed and its a good splat. I also kind of like the way some of the 'rougher' splats look. I feel like they'd work well in a car racing simulator.

It's funny that the context window size is such a thing still. Like the whole LLM 'thing' is compression. Why can't we figure out some equally brilliant way of handling context besides just storing text somewhere and feeding it to the llm? RAG is the best attempt so far. We need something like a dynamic in flight llm/data structure being generated from the context that the agent can query as it goes.

I don't know man. I'm writing a flashcard app, and I like it. It makes me happy and it works the way I want. Exactly how I want. BC I could never get into quizlet. Whatever. Maybe others will like it, maybe not, I don't care.

Taste is subjective. Having 1 million todo apps, great. Maybe someone I know will find one they like and tell me about it. Maybe I'll find one that doesn't suck. Maybe I'll just make my own.

One thing I won't do though, is complain about how there's now 1 million todo apps that aren't up to my standards. Everyone being able to make their own apps however they want is a beautiful thing.

To your point, from the article: "To me, giving a Claude skill all your credentials, and access to everything important to you, and then managing it all via Telegram seems ludicrous, but who am I to judge."

So now you know. You can get claude to write you a ton of unit tests and also improve your static typing situation. Now you can restrict your prompt!

I don't know about Jetstream, but redis cluster would only ack writes after replicating to a majority of nodes. I think there is some config on standalone redis too where you can ack after fsync (which apparently still doesn't guarantee anything because of buffering in the OS). In any case, understanding what the ack implies is important, and I'd be frustrated if jetstream docs were not clear on that.

This makes sense to me. Where I work our ai team set up a couple h100 cards and are hosting a newer model that uses up around 80GB vram. You can see the gpu utilization on graphana go to like 80% for seconds as it processes a single request. That was very surprising to me. This is $30k worth of hardware that can support only a couple users and maybe only 1 if you have an agent going. Now, maybe we're doing something wrong, but it's hard to imagine anyone is going to make money on hosting billions of dollars of these cards when you're making $20 a month per card. I guess it depends on how active your users are. Hard to imagine anthropic is right side up here.

So in terms of OCR, does the neural network 'map' the words into an embedding directly, or is it getting a bunch of words like "Hamlet's monologue" and mapping that to an embedding? Basically what I'm asking is if the neural network image encoder is essentially doing OCR 'internally' when it is coming up with the embedding (if that makes any sense).

13 minutes in Andrej is talking about how the models don't even really need the knowledge, it would be better to have just a core that has the algorithms it's learned, a "cognitive core." That sounds awesome, and would shrink the size of the models for sure. You don't need the entire knowledge of the internet compressed down and stashed in vram somewhere. Lots of implications.

Well I don't know about others here, but I think its cool. If you can make the setup super readable and get the performance of C then why not? Especially now when you can get claude to write a bunch of the framework for you. Add in whatever you need whenever you need it and you automatically have a platform independent web framework that's no bigger than what you need and likely decently performant.

I think its just a simple matter of aesthetics. Some people find violence ugly, and don't like looking at it. Some people think that by looking at it you're somehow coming to a greater understanding of the world or something. Maybe that is the case for some super sheltered individuals, but I doubt it's the case on the whole.

If anyone has any ideas on what the point of violence in art is, I'm open to hearing it. Obviously horror is a genre and so is gore, and people seem to enjoy being shocked. I don't think that is what McCarthy was going for though. And he wasn't going for the vengeance-catharsis angle like Tarantino either.

My hypothesis: the length of the prompt shrunk, yet maintained the same amount of information.