Comment by flockonus

It depends! If a startup is entering with a large model to face other larger models, it must be better at least in 1 meaningful dimension.

500B params performing worse than other OSS of the same size is pretty meaningless if no one will use it.