fnbr
Joined 13 years ago
Joined 13 years ago
There's a bunch of other fully open models, including the [Marin](https://marin.community/) series of models out of Stanford and Nvidia regularly releases fully open models.
I do think that MoEs are clearly the future. I think we will release more MoEs moving forward once we have the tech in place to do so efficiently. For all use cases except local usage, I think that MoEs are clearly superior to dense models.
Where did you try this? On the Ai2 playground?
7B models are mostly useful for local use on consumer GPUs. 32B could be used for a lot of applications. There’s a lot of companies using fine tuned Qwen 3 models that might want to switch to Olmo now that we have released a 32B base model.
1) the company has Nx preferences, for N >1, in which case the company has essentially failed to fundraise or
2) the company sells for less than they raised, which again, is a polite form of failure.
this is basically Inflection 2.0.
I love receiving emails. If you’re on HN, I would enjoy talking to you. Yes, you.
I'm an AI researcher and (small-time) angel investor.
I’ll happily talk to you about your startup, strategize about how to pitch VCs, or give advice on how to get a job in tech. You are not wasting my time.