why_only_15

Joined 8 years ago

Karma
1,060
Submissions
464
Member since
Sep 11
homepage: https://girl.surgery
View on Hacker News

Recent submissions

Comment · 1 month ago
Why do you think the Chinese labs figured this out before the western labs? No reason to believe that whatsoever.
Comment · 1 month ago
yeah there's some KV cache offload
Comment · 1 month ago
This is just wrong unless you're using some confusing definition. Notice that companies trying to do lots of inference aren't looking for CPUs, they're looking for GPUs/TPUs.
Comment · 1 month ago
CPU DRAM can't really be used for inference efficiently -- inference mostly wants memory bandwidth, not memory capacity, and GPU DRAM has >10x more bandwidth. The fabs can switch between them but you can't switch after the fact.
Comment · 1 month ago
They have various benchmarks, e.g. how much time it takes them to do wikipedia page -> page games. Jev seems to take the same or fewer hops but in ~10x less time and for ~10x less money.

It's totally reasonable to compare against LLMs doing chain of thought if it gets comparable performance.

Comment · 3 months ago
To what degree can you say something like "if the kernel doesn't have metaprogramming [or some other set of features] it's fine". When were the last bugs with a reduced feature set?
Comment · 3 months ago
The whole point is that these are security bugs that didn't necessarily bother people so far but could be exploited
Comment · 3 months ago
Comment · 3 months ago
Comment · 3 months ago
Comment · 3 months ago
Comment · 5 months ago
why do you think so? they provide some evidence of this in the article, but there have been several improvements in e.g. nanogpt-speedrun or openai parameter golf made by AIs
Comment · 5 months ago
Does China subsidize housing construction? Is your claim something like "China encourages/forces consumers to save at high rates which lowers interest rates and makes there be more construction"?

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton