Comment by wanderingmind

I like the hacking spirit suggestion. But my disagreement is the specificity of it. The suggestion here seems more inline with not tinkering and hacking but first principles learning typical of science and math curriculum. What made hacking radios and JS cool was the short feedback loops to see the progress you made. Unfortunately for LLMs starting from scratch doesnt give a good feedback loop on improvement, although starting from pre-trained model to quantising, fine-tuning might be more aligned with the hacking culture