amemi
Joined 7 months ago
Joined 7 months ago
I think there is some worth in having someone knowledgeable using AI to generate educational material, although it will be in my opinion, of less use than if that knowledgeable person wrote the material by hand.
For example, many professors in universities have started generating slides or even assignments using AI. A knowledgeable teacher who cares about their students outcomes can generate better material.
Perhaps it is the contrast of "freely recommending" and "always should be considered carefully"?
Or taking a larger leap: the awkwardness of saying how hard (isolating) it is to do a PhD in an unfamiliar country, then saying that you enjoyed it, but others should consider it carefully?
While phrases like "contemporary phenomena" and "tendency to be commensurate" are a bit over-the-top, summarily the picture is conveyed much more clearly imo: Luck plays a factor, no matter how good you are.
I don't see how "nor yet favor to men of skill" is more natural or clearer, at least to the modern reader.
The difference: LUX-ZEPLIN, which is underground, is waiting to detect a dark matter particle itself. On the other hand, NGRST seeks to observe the effects of dark matter.
Previously: https://news.ycombinator.com/item?id=42021237 Linux on Apple Silicon with Alyssa Rosenzweig
For example, with frontend, I can get an LLM to design half a page 80% to my satisfaction with two paragraphs worth of a prompt. "It should look like so, and have a text box here, and room for a demo there".
With ML training or backend or user-facing code, I might instead spend a paragraph thinking out my design intentions for a single function or even a single line, more for myself than the LLM. A harness generates a plan based on that paragraph, which one can then comment on and review the pseudocode it provided, ensuring it aligns with expectations.
Lastly have the LLM output some sort of documentation and "here's what I did" after each change. Your final step is to handwrite (paraphrasing what it gave) into any docs or commit messages, and ensure your commits are small enough to keep this maintainable. Paraphrasing the LLM, rather than the LLM paraphrasing you, is helpful to ensure the commit messages make sense to you three months from now.
https://x.com/keshavchan/status/1787861946173186062
In my opinion, whether it was actually by Ilya or not is not worthy of debate. Many of them are widely recognized for being good pedagogical resources (e.g. annotated transformer, unreasonable effectiveness of RNNs, understanding LSTM networks), and others are landmark papers which anyone interested in the field would benefit from reading:
- Krizhevsky et al. (2012) introduced AlexNet
- Bahdanau et al. (2014) introduced attention
- He et al. (2015) introduced ResNet
- Vaswani et al. (2017) introduced the Transformer
Other papers are more specialized. Of them, I think Kaplan et al. (2020) by OpenAI is probably most important.
Also useful is Steve Brunton's channel [3]. He has a freely available book [4] co-authored with Nathan Kutz that ties machine learning and control.
[1] https://engineeringmedia.com/ [2] https://www.youtube.com/@BrianBDouglas [3] https://www.youtube.com/@Eigensteve [4] https://news.ycombinator.com/item?id=36374528
I have observed that models are not able to effectively come down to a human level. They are mediocre at approximating what a first-time reader would want to know. If you will forgive the anthropomorphization, they are not very empathetic. In this book for example, the author pauses the flow of thought with countless little anecdotes, anticipating where the reader might have a question or want to know more.
Of course, a well-guided AI is capable of anything a human is capable of. But is that not tautological?