segmondy

Joined 13 years ago

Karma
8,996
Submissions
3,552
Member since
Jan 30
Builder of thingz, lover of old robust tech like unix, prolog, lisp, APL, forth, postgresql, but don't mind the shiny new things ... right now, I'm all in on GenAI, Local LLMs & LLM driven agents, team llama.cpp, building LLM agents since 2023

segmond AT gmail dot com

View on Hacker News

Recent submissions

Comment · 2 days ago
Yes, quite a bit, but you can lookup OlMo from allen.ai for starts
Comment · 2 days ago
Comment · 2 days ago
Do we still trust the data coming out from this admin?
Comment · 2 days ago
Their last 2 models were a disaster and didn't live up to their self reported evals. I hope this time around is much better. I'm happy tho that they are still figuring out how to get better even if only measured against themselves. This is great, the more options we have the better for everyone.
Comment · 4 days ago
It will never get declassified. Never. The people get weaker and more passive with time, the govt gets stronger and reckless and less accountable.
Comment · 4 days ago
With Anthropic going public, I expect a lot of model releases from the competition signalling to the market. "We are still around, please leave some money for us too"
Comment · 4 days ago
why would they think that? I'm not a pro, but I know you can't serve more than kv cache pool that you have. If you want to run concurrent requests, you need to have more kv cache pool than your context window. The entire thing is weird, my bet is they were thinking most people will be using about 100k cache, compacting, etc and not nearing 600k ever.
Comment · 4 days ago
Doesn't matter, they could have marketed it as 1 million token window, you would then infer, get to 600k and get an error. You won't be able to finish your work, and you won't get credit for 600k tokens.
Comment · 4 days ago
"We deployed GLM 5.3 with a 1,048,576-token context window, but the KV cache pool on our prefill GPUs only had room for 681,280 tokens. We were aware of this mismatch before launch. "

Did they advertise it as 1,048,576 token when they only had room for 681,280 tokens?

Comment · 5 days ago
This is exactly the point! The chinese labs have been sharing amazing research and breakthroughs.
Comment · 5 days ago
They implemented efficient caching and ideas from Deepseek and the Chinese labs. They can now server cheaper and faster.
Comment · 5 days ago
You can vibe up your own distinctive user interface today! it's 2026.
Comment · 5 days ago
This is pretty awesome! Thanks for sharing. I was playing with it and had to stop! Brings back lots of good memories.
Comment · 5 days ago
Cloud models sometimes get degraded. You can trust your local model and know what you are running.
Comment · 5 days ago
Have you heard the cost of health insurance and seeing a doctor? Some people don't see going to hospital as an option. Better for them to have a local model than no options. But let me tell you how I use it for health, I take all my health records, lab results, every thing, I throw it in there for a second opinion, it explains things to me, it suggests questions I should ask on follow up, possible options, etc.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton