To be clear I was making a wish for the future, I wasn't saying that Mistral were bad for not doing this today, that obviously wouldn't really be technically feasible.
Given the rate of progress of LLMs, I wouldn't be surprised if we had decent fully open and reproducible models within a decade or so, especially once the current spike in hardware price passes and building a local training cluster will be more realistic.
Given the rate of progress of LLMs, I wouldn't be surprised if we had decent fully open and reproducible models within a decade or so, especially once the current spike in hardware price passes and building a local training cluster will be more realistic.