Comment

Comment by probst

Thank you for the link to your harness! Looks quite interesting.

What type of ongoing tuning do you do for your model+provider+harness combo, and when do you know it's time to redo it? Or more specifically, when you do the tuning, how do you actually go about doing it?

I am mostly using omp (omp.sh) which is very tunable, and I did some tuning for one of the GLM models in the past (mostly based on vibes because people said it was getting dumb like a brick after some context lengths so I had omp compress sooner).

parent probst 4 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton