reissbaker

Joined 15 years ago

Karma
6,176
Submissions
1,344
Member since
Oct 11
I make https://synthetic.new
View on Hacker News

Recent submissions

Comment · 11 hours ago
No, their report mentions that despite intentionally removing dual-use cybersecurity training data, K3.1 is better than K3 at cybersecurity tasks (both defensive and offensive), because it's just a lot better at coding in general. It's just not as good at cyber as the unrestricted version of K3.1 that they trained initially and didn't release.
Comment · 11 hours ago
Comment · 4 days ago
"One implementation of a feature had a bug, therefore this feature should be turned off on all implementations by default" is probably not going to convince people who think the feature is good.

If you don't want to be able to have clickable hyperlinks, by all means use Konsole — no one is forcing you to use Ghostty. But if you want to know why people like Ghostty's approach vs Konsole's, it's because Ghostty pushes terminal emulator features forward and is low latency. Konsole is low latency and adopts some but not all features that other people invent. It's a noticeable difference and so people who like the feature part of the former like Ghostty/WezTerm/Kitty more than Konsole. If you don't care or dislike that part, and want a more conservative terminal (that is also low latency), Konsole and many others further on the conservative spectrum exist.

Comment · 4 days ago
Apple Terminal doesn't support:

1. The Kitty keyboard protocol, which makes it impossible to distinguish e.g. Shift-Enter from Enter

2. OSC8 hyperlinks

3. It breaks on APC queries, so you need special handling to not emit them

4. Symbols for Legacy Computing Unicode support

5. The Kitty Terminal Graphics Protocol (or sixel)

6. OSC 9 notifications (or any of the later versions)

and a bunch of other stuff, this is just off the top of my head. For a long time they didn't even support 24-bit color, although they fixed that in Tahoe.

It's totally fine for basic UNIX tooling, but pretty painful if you're trying to make nice interactive TUIs.

Comment · 4 days ago
Yes, I agree. Ghostty et al don't open-on-click, but on hover they'll show you the URL and there's a keyboard shortcut + click to open. This is much better UX than disabling OSC8.
Comment · 4 days ago
A couple of annoyances I've had shipping CLI apps to Konsole users:

1. By default, Konsole disables OSC8 link support. Users can enable it manually, but you need to ship fallbacks by default since otherwise the default users will have a broken experience. Ghostty, Kitty, WezTerm, etc all ship working OSC8 support out of the box.

2. No built-in Nerd Font support, so if you want to render icons, you need to tell your users to set up a patched font or else have fallbacks. Ghostty and WezTerm ship built-in Nerd Font fallbacks if your configured font isn't patched.

That being said Konsole is much better than most emulators. iTerm2 is not bad, although it lacks Symbols for Legacy Computing Unicode support (which all of the above have, including Konsole, and which is very useful for drawing prettier terminal UIs). The worst by far is Apple Terminal, truly the IE6 of terminal emulators.

Comment · 8 days ago
Moonshot has been frontier since this summer. At this point whenever they release a model it's on par with whatever the latest OpenAI/Anthropic model release was.

Not sure I'd put Google there in practice. And while Muse is an impressive jump from behind it's still not quite at the frontier either IMO.

Comment · 14 days ago
I've also found this to be true of Kimi K3. I still reach for the Astra power tool for especially hard problems, but it needs a lot of cleanup when it's done — whether on hard tasks or easy ones. So unless I need it I prefer the Chinese models, since if they get the job done it doesn't need much post-processing.

(I truly despise the code Fable generates and IMO it has fewer IQ points than Astra so it's not really in my toolbox these days.)

It's a bummer that American open-source is so bad though.

Comment · 20 days ago
The prediction was a 10x price reduction, so equivocating about "we don't know the size" doesn't save their prediction — a 10x price reduction would imply the model was likely more than 10x smaller in parameter count, and the price factored heavily in their prediction (they predicted its low cost would destroy other competition, since no one else could have such a capable model at that low price). And Haiku/Luna are nowhere near competitive with Astra or Fable, which doubly damns their prediction. I'm surprised you would pooh pooh the equivalence of K3 and original-Fable (which has been widely shown across many different benchmarks and even human preference data), while claiming an equivalence between Haiku and Fable!
Comment · 20 days ago
Everything starting from mid-2026 is incredibly wrong, which is pretty poor predictive performance considering they published it mid-2025. List of misses:

- In mid-2026, China will be six months behind the released models of the American labs. (In mid-2026, China released Kimi K3, which was equivalent to the best released U.S. model at the time, Claude Fable.)

- In mid-2026, China will nationalize all domestic AI labs and centralize them into a new special economic zone, the "CDZ," created around a nuclear reactor. 80% of all chips in China will be redirected to the CDZ. This uh. Obviously didn't happen.

- In late 2026 OpenAI/Anthropic will release a tiny model that outperforms their previously-best 2026 model (Astra/Fable), that is priced 10x cheaper, and they will market fine-tuning for it. (Lol.)

- AI will increase the stock market by late 2026 by 30% (in fact the S&P 500 is up 13.9% YTD, which is pretty good, but not at all out of the ordinary).

Their predictions for 2027 also seem pretty wrong: e.g. they expect continual learning to be solved in January, and RSI including from a research perspective, not just "optimize CUDA kernels," to also be solved in January, which I suspect no serious lab employee believes anymore. Most lab employees believe RSI will happen (as do I!), of course, but not in two and a half months.

By early 2027 they expect cyberwar with China because China has stolen the weights of a model and smuggled it into the CDZ.

By mid-2027 they expect true superintelligence, where essentially all engineers and researchers are useless, unable to comprehend the advances the AI is able to make and largely unable to even usefully manage or steer AI, who are better at self-managing than a human would be.

Considering their 2025-mid-2026 predictions were basically "progress continues as normal and nothing crazy happens," it's not super surprising that they were more or less right about that. Their 2026/2027 predictions were the spicy ones, and none of them have happened, or are even on track to happening!

Comment · 26 days ago
At least for RL, you don't need a base model — the rollouts are run in an inference engine with an instruction-tuned model using a chat template. You can start with just that!
Comment · 26 days ago
Comment · 1 month ago
20k tok/sec prefill on B200/B300 isn't particularly noteworthy for medium-sized models like GLM-5.3-Flash, vLLM and SGLang achieve it on a reasonable number of models, especially at NVFP4.

50k tok/sec is pretty impressive though.

But... when you were doing your measurements, were you using the same random book excerpt? If you were potentially getting even partial cache hits for your 50k tok/sec measurement, it would taint the benchmark: pretty much any inference provider running any LLM would be able to hit those numbers.

Comment · 1 month ago
I feel like you could use an open-source harness like Pi and get 100+% of what these closed APIs offer without getting locked to OpenAI. What do you think is missing from them?
Comment · 3 months ago
No, OpenAI did not publish how they trained o1, and at the time there was significant misunderstanding and belief in the research community that they were using some kind of Monte-Carlo tree search. DeepSeek figured out GRPO on their own. Similarly, while others invented MoEs, DeepSeek's ultra-sparse variants were extremely novel, to the point where the revelation of how efficient they were to train temporarily collapsed Nvidia's stock.

Regardless I think it's impossible to believe that most LLM research was done by closed labs that don't publish, especially Anthropic (who missed out on and copied two of the largest pieces of important research of the last several years), and that none was done by open labs like DeepSeek, and that the open labs are just copycats. It's quite clear that isn't the case.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton