probst

Thank you for the link to your harness! Looks quite interesting.

What type of ongoing tuning do you do for your model+provider+harness combo, and when do you know it's time to redo it? Or more specifically, when you do the tuning, how do you actually go about doing it?

I am mostly using omp (omp.sh) which is very tunable, and I did some tuning for one of the GLM models in the past (mostly based on vibes because people said it was getting dumb like a brick after some context lengths so I had omp compress sooner).

Yeah, good point. For HTML/CSS/JavaScript it seems to do fine. Maybe I am just asking too much of it, with a codebase spanning Rust and Elixir and doing some more low-level stuff in-between...

Last year I didn't use any of the model (other than for chat and some snippets here and there), exactly because I didn't think them good enough. It should be said that I think DS is vastly better than that, but I think the closed source frontier models are just so good by now, that stepping down to "N-X" months just feels all the more painful.

Ah, interesting use cases for DS! I haven't had these needs yet, which maybe also explains why I haven't considered using DS for them. Thanks!

Would you please elaborate on "really decent"? Really decent for what use exactly? I want to love it (and use it as a cheaper research model in my harness), but I really cannot get any real development done with it? It stumbles and fumbles and over-complicates, where astra just plows ahead (often in less overall time) with excellent solutions.

I really want to love this model, particularly since it's good to have an open weight model on my team so to speak, but I think I might be holding it wrong.

What are you using it for?

Exceptionally well is my takeaway. It’s the only harness I am using these days. I was previously using pi and codex mostly, but also the ones built into editors like zed, vscode, and the jetbrains IDEs.

On top of that, somewhat unrelated I’ll agree but still, it has support for vim keybindings

Way to restrictive in terms of tokens provided. I am on their largest plan, and quickly run into their limits. And that is using it selectively in addition to codex.

I have been a long time subscriber to the economist for the same reason. The print edition is great and keeps me feeling informed. If only it wouldn’t include the digital edition too… Invariably, the more stressed I get in my everyday life by work and small children and lack of sleep, the more I get dragged towards the online edition of the economist, and BAM I’m back in the constant instant news cycle again, even though the site doesn’t update that often.

My latest life hack which I can recommend to anyone, at least in Germany: as part of my local library membership I get access to the PressReader app, which gives me access to the print edition of the economist! At 10 EUR a year it’s so affordable it nearly feels like it’s unethically so for what I get. I guess I’ll close with: May we forever be blessed with libraries, and may they never be „optimised away“ as an unnecessary social good.

Yes, I was so close to signing up for a pro account to get some inmail credits to be able to write someone directly, but then I decided to try writing here first lest I be stuck in a pit of dark patterns trying to cancel my subscription. I would however have been my next step.

I finally heard back! Thank you! I think this thread might have helped!

And I totally agree with your thoughts on the criticality and inadequacy of AI replies in such a context! Lack of answers was holding a months worth of income hostage with no real recourse for us other than trying to be loud online. Kind of sad.

Looking at alternative merchant of records now to buy us some optionality.