juliangoetze
Joined 1 year ago
Joined 1 year ago
Non-public benchmarks (ideally suited to one's own use case) are probably the best way to judge, I agree.
How can you tell?
I just looked at the benchmarks and was kinda disappointed that it seems to be between KimiK2.6 and KimiK2.7 on most of the benchmarks.
Do you refer to what it feels like to use the model? Or are there other benchmarks I haven't seen?
"Evaluating Spülenposition gegen Wasseranschlussabstand" and "Analysierend die Platzierungskonflikte und Rohrleitungszwänge klären" are examples of generated summaries.
I wish someone could explain this - because I see no way that sentences like these would show up in training data. But maybe the RL for thinking has some quirks?
so, i guess YOLOing it is the best way to put it
People then found the courage to contribute themselves. We haven't really pushed for contribution so far!