cottonseed
Joined 15 years ago
Karma
2,959
Submissions
591
Member since
Aug 22
email: <username first word> dot <username second word> at gmail
View on Hacker NewsJoined 15 years ago
Ultimately, I don't think this is really practical, and investing in AI proof agents is the way to go.
https://www.eleuther.ai/projects/gpt-neox/ https://github.com/EleutherAI/gpt-neox https://arxiv.org/abs/2204.06745
They have a 20B parameter model. I think the primary dataset for these open models is The Pile: https://arxiv.org/abs/2101.00027 (web scrape, pubmed, arxiv, github, wikipedia, etc. There is a nice diagram on page 2 that summarizes the contents.)
> AllSpice: A git platform for hardware engineers