MurizS
Joined 8 years ago
Karma
673
Submissions
63
Member since
Aug 21
Joined 8 years ago
For reference: In the Llama 3 technical report (2407.21783), they mention that they ended up using 17% code tokens in their training data.
HN discussion (4 months ago): https://news.ycombinator.com/item?id=39191899
https://hesiod.ch/