Comment Comment by phamilton Simple math:A training set of 15 trillion tokens is 10 trillion words.A penny a word is cheaper than the cheapest beginner freelance writer.That makes a training set of 10 trillion words cost $100B.Lots of assumptions there for sure, but we're certainly in the ballpark you are describing. parent phamilton 1 month ago
A training set of 15 trillion tokens is 10 trillion words.
A penny a word is cheaper than the cheapest beginner freelance writer.
That makes a training set of 10 trillion words cost $100B.
Lots of assumptions there for sure, but we're certainly in the ballpark you are describing.