ssabev

Came here to agree.

Initially I thought it's a bloody stupid idea, however at this stage I reckon we need it or a lot of boomers are going to be ones hotted into singing away all their wealth away.

love grok3? can't wait for official api?

now you can run an openai-compatible proxy for all of your "local model" needs.

currently using it as my custom provider in repoprompt

pkg includes: client, cli, and proxy

The ELO leaderboard you mean?

Spoiler: it's fast, cheap, overly protective, and has Kafkaesque DX

Hey folks, any of you tried with this stream=True? It works in the playground, but it appears that you cannot actually stream completions from this model via the python openai package.

Wondering if it's a weird PEBKAC or someone else has had the same experience?

Absolutely mad... Saw this and thought - what the hell. I have to say moving away is starting to feel really tempting

Absolutely agree here. We should be intolerant of intolerance in democratic societies and reciprocate with the more questionable counter parties from countries with .. shall we say different moral norms.