qntty

Math isn't useless. One of its defining features is its "unreasonable effectiveness" in formulating scientific ideas. It's hard to say exactly why it's so useful, but it is, even if mathematicians aren't trying to make it useful.

It's not at all clear whether the kind of math created by LLMs will retain the usefulness of the old math. LLMs are good at rigor but bad at intuition. It's not even really clear if the rigor was ever all that important. Theoretical physics is full of people using math in ways that don't meet the bar of rigor that mathematicians set for themselves, but they have enough physical intuition for what they're doing, so it doesn't matter. It's an open question whether post-LLM math will continue to supply scientists with the kinds of ideas that they need from it.

Second this, I learned to solder in my EE program and didn't discover these videos until I was done. I wished I had watched them sooner.

I use Pydantic Settings for this, would be nice to see a comparison to that. I do like the idea of keeping this in a configuration file.

Pre-training mean exposing an already-trained model to more raw text like PDF extracts etc (aka continued pre-training). You wouldn't be starting from scratch, but it's still pre-training because the objective is just next token prediction of the text you expose it to.

Post-training means everything else: SFT, DPO, RL, etc. Anything that involves things like prompt/response pairs, reward models, or benefits from human feedback of any kind.

> Sometimes a law is just on its face and unjust in its application. For instance, I have been arrested on a charge of parading without a permit. Now, there is nothing wrong in having an ordinance which requires a permit for a parade. But such an ordinance becomes unjust when it is used to maintain segregation and to deny citizens the First-Amendment privilege of peaceful assembly and protest.

> I hope you are able to see the distinction I am trying to point out. In no sense do I advocate evading or defying the law, as would the rabid segregationist. That would lead to anarchy. One who breaks an unjust law must do so openly, lovingly, and with a willingness to accept the penalty. I submit that an individual who breaks a law that conscience tells him is unjust, and who willingly accepts the penalty of imprisonment in order to arouse the conscience of the community over its injustice, is in reality expressing the highest respect for law.

I always have to go back to read this part again because I feel like it's so unexpected. You don't really hear anyone saying quite the same thing today.

Solved how?

Writing a calculus book that's more rigorous than typical books is hard because if you go too hard, people will say that you've written a real analysis book and the point of calculus is to introduce certain concepts without going full analysis. This book seems to have at least avoided the trap of trying to be too rigorous about the concept of convergence and spending more time on introducing vocabulary to talk about functions and talking about intersections with linear algebra.

I tried and failed to find some kind of concrete methodology that they used to get to the number 30 months. I'm still waiting for quadratic algebra to make my knowledge of linear algebra obsolete.

I like the subway analogy. I'm sure I've heard some version of it before, but maybe because I was younger I didn't really get it. It really is a little strange to tell kids who have never really directed their own lives before to start doing it all of a sudden.

Child-proof caps are easy to take off but difficult to accidentally take off.

You're right, I was confusing TensorRT with Dynamo. It looks like the relationship between Dynamo and vLLM is actually the opposite of what I was thinking -- Dynamo can use vLLM as a backend rather than vice versa.

It sounds like you might be confusing different parts of the stack. NVIDIA Dynamo for example supports vLLM as the inference engine. I think you should think of something like vLLM as more akin to GUnicorn, and llm-d as an application load balancer. And I guess something like NVIDIA Dynamo would be like Django.

In Hindi, “gandi” means dirty, which I guess is appropriate for marches