cayleyh
Joined 12 years ago
Karma
123
Submissions
64
Member since
Aug 1
Joined 12 years ago
If getting this status helps simplify process and costs of EU<->Canada military procurement, then it will be a clear win for both sides given the current desire to reduce dependence on US defence providers.
Same. But if I was working for an organization that measured token usage, you can bet I would be doing things like creating a cron job that uses claude to create a customized bespoke report update of the current status of all my open assigned tickets and message that to myself 4 times a day... token burn for zero purpose whatsoever.
Is it really just that Anthropic now owns bun and zig is "anti-LLM" for contributions? Was there more justification given elsewhere?
Not a lot of public data about things like that at scale, but there are some things like the Meta Llama report that had ~ 9% annualized gpu failure rate while training Llama 3. Not 100% clear from the Meta report if those are dead hardware or just 'unhappy' because they just put them into the 'interruption caused by' bucket.
Would be interested if anyone had better data on actual live failure rates of h100 or better class gpu that suck so much power.
https://ai.meta.com/research/publications/the-llama-3-herd-o... https://www.trendforce.com/news/2024/10/31/news-datacenter-g...