> Once a model is built, the biggest cost is inference
Something i cant find any reliable data for, but would help for a sense of scale: How much use before its equal to training?
I.e. assuming you have the training data and setup, and we only care for compute - How hours of using eg Kimi K3 / Fable, for it to equal the compute required to train it?
Something i cant find any reliable data for, but would help for a sense of scale: How much use before its equal to training?
I.e. assuming you have the training data and setup, and we only care for compute - How hours of using eg Kimi K3 / Fable, for it to equal the compute required to train it?