Comment Comment by tosh blog post: https://x.ai/blog/grok-os * 314B parameters (86B active at a time) * mixture of experts 8 (2 active at a time) * weights and architecture licensed under Apache 2.0 (edit:) announcement blog post from last year with benchmarks compared to Claude 2, GPT-3.5 and GPT-4: https://x.ai/blog/grok(edit2:)TL;DR: somewhat comparable to GPT-3.5, Mixtral and Qwen-1.5-72B in capability but way larger than the open weight models parent tosh 2 years ago
(edit2:)TL;DR: somewhat comparable to GPT-3.5, Mixtral and Qwen-1.5-72B in capability but way larger than the open weight models