harlequinetcie
Joined 4 years ago
Joined 4 years ago
You could guess, but would that change something?
If you introduce too many changes at the same time, how can you attribute what works and what not?
That's the other challenge we are seeing, and that gets worse if you have bigger teams.
Centralized intelligence helps, but enforcing the correct coordination... feels like we are missing a new type of role.
DeepSeek caveats: + You have an LLM-Agent-UMF architecture. Vanilla pi harness fails. + Coding tasks are lousy. Beyond coding, difficult open-ended reasoning scenarios are the ones at which it performs best for us.
It would have been much better if it was a skateboard, tbh.
Fun stuff!
Eventually providers that host models with tight restrictions will become popular just because of this. Everyone is collecting data, one way or another one.
What's funny for me? -> Companies are still signing multi-year contracts with big labs so they can send all their data there. -> If I was a big lab, I just need to learn behavior, not necessary even understand the messages, to take my software to the next level.
But who knows, I'm no genius.
-> Clairic extracts the PR's claims -> Jev tags diff hunks, then judges what requires a review. -> Cheap(er) model to review the hunks.
For us, we've got PR reviews in under 30 seconds, and cost down to a few cents.
Next step, we are thinking on training some small open weight models specialized on our repo.
Thoughts?