selfhoster11

GLM-5.3, Kimi K3. OpenRouter is good for figuring out which provider you want with the serving precision that you need.

I have at one point faced the “should I buy x86 instead”, and decided low-power Intel CPUs make it viable. Guess I’m gonna pick the x86.

Lol, no.

Tinfoil etc offer TEE inference that works well, directly or via API routers.

Why would you not put a CDN in front? I’d rather do that than CAPTCHA.

Would you mind opening it to the public? We’d be okay making modifications for our use cases, so dumping the code would be fine.

Interoperability clause in the EU might make it legal? Not sure.

That’s just how some humans write. These words didn’t come from an LLM vacuum.

Difficult texture, but I appreciate the disclosure of AI use and found some of the points interesting enough to write my own essays on.

Moonshot.

Under Linux it is allegedly 110GB, but I’m not sure.

Executive dysfunction mitigation. Voice based interfaces. Heavyweight personal file classification with a few hours of prompt building vs labelling a bespoke classifier’s data set and training a more “lightweight” option in weeks or days. Language translation that isn’t DeepL or Google Translate for random websites. They are not deterministic, but the error rate is a lot better on these tasks vs classical approaches.

That's like saying we shouldn't be letting people access glasses or wheelchairs because we need a way to fix the issue at the root. Nope.

I use both of these and I don't think I've once had an LLM rewrite my comment before posting it on HN.