Comment Comment by kingstnap If you think of LLMs as programs. The weights and inference code are very much a binary.While the training code and data are the true source. Since if you want to robustly modify the LLM that's actually what you need.But since "compilation" (training) is extremely compute intensive this isn't something accessible to anyone without an entire datacenter.Anyway semantics aside having the binary is still infinitely better than dealing with an api as far as privacy and control go. parent kingstnap 2 months ago
While the training code and data are the true source. Since if you want to robustly modify the LLM that's actually what you need.
But since "compilation" (training) is extremely compute intensive this isn't something accessible to anyone without an entire datacenter.
Anyway semantics aside having the binary is still infinitely better than dealing with an api as far as privacy and control go.