konmam

Might give it a go, would be nice if there are some gains to be made. Though even then, need to think what’s my threshold where I would go this is good enough for me to use instead of defaulting to claude/openai/deepseek.

Yeah, maybe once the price wars settle down, but at this point no real reason with what you can get basically for free.

Well considering I can just use DeepSeek for pennies, not sure what I might get out of that 1 tk/sec locally.

Maybe the question is not can you, but rather should you?

Ah yes, a topic for HN