labcomputer

Joined 14 years ago

Karma
2,317
Submissions
1,044
Member since
Aug 2
View on Hacker News

Recent submissions

Comment · 3 days ago
Right. Couple things to note though:

- Larger MoE models only need compute proportional to the number of active parameter, so Qwen3.8-Flash-Next (180b with 6b active) runs more tok/sec than Qwen3.8-27b on the same hardware.

- Larger models typically have higher quality output and require fewer thinking tokens to get to an answer.

Consequently, measuring time to complete a task with a wall clock, the speed difference is less than you would expect.

Comment · 3 days ago
Large mixture-of-experts models, like Muse Spark or Kimi K3.

MoE models want a different ratio of memory/compute/$ than dense models like a Gemma4 31B or Qwen3.8 27B.

Since only some of the experts are active each round, you don’t need as much compute to get good tok/sec, but you do need a lot of memory to avoid streaming weights from SSD or system RAM.

You could run a full Muse Spark on one of these for $24k at probably around 50 tok/sec.

You’d need 5x RTX 6000 Pros at $80k for Muse Spark (albeit at much higher tok/sec).

On a $24k budget, you’re looking at a maximum of 96GB from Nvidia or 384GB from Intel or AMD. So you’re bottlenecked by PCIe bandwidth, and all those TFLOPS go to waste.

Other configurations of the Studio have similar logic for other MoE models. For instance, Qwen3.8 flash-next runs at a very acceptable 75 tok/sec on a 128GB M5 Max for about 1/3rd the price of an RTX 6000 or 40% less than 4x B70’s.

Comment · 4 days ago
Iridium still has a monopoly on high latitudes, too, AFAIK. Their USP is being the only network that works literally anywhere on the surface of the earth.
Comment · 4 days ago
A $2500 Mac Studio with M5 Max running Qwen3.8-27b or Gemma4:31b in oMLX gets about the same speeds you quoted... and it comes with a warranty and has enough memory not to choke at longer context lengths.
Comment · 4 days ago
SSD token caching (like oMLX does) goes a long way for prefill. Typical miss rates are under 5% in long coding sessions, which is mostly the output of a turn's tool use.
Comment · 4 days ago
iPhones have great cameras. Get a MagSafe mount for on top of the monitor and stick the camera to it. The feature is called "continuity camera", and it works with any Mac app that would use a USB webcam.
Comment · 4 days ago
The Dell is only 450 nits, and the Kuycon site says the it costs $1050 delivered to the US with a stand ($950 if you BYO VESA stand).

Even using the sale prices, an iMac is still cheaper than a Mini with the Kuycon.

Comment · 4 days ago
And it's almost impossible to find ones that get as bright as Apple monitors for less than Apple charges!

My absolute favorite feature of Apple displays is that I don't need to have the brightness cranked to max all the time, even when sitting next to a window. Some of them are, dare I say it, too bright for a normal office at maximum brightness (yet still dim for comfort in a pitch black room).

There are some good alternatives if your budget stretches to $1000, though: Samsung's 27" ViewFinity S9 comes to mind, with 2880p and 600 nits.

Comment · 5 days ago
That's a common misconception. You can't make the calculation purely on the mass of raw material needed to get a X kg of Y% material.

Every enrichment process drops in efficiency as the enrichment increases, asymptotically approaching that process's enrichment ceiling.

That's why nobody uses thermal diffusion to enrich uranium: It's by far the easiest method (you can do it with 1800's technology), but the practical maximum enrichment fraction is too low for anything useful (other than providing feedstock to better enrichment processes).

That's also the reason a centrifuge enrichment plant uses warehouses full of cascaded centrifuges: The centripetal force inside the centrifuge is working against a diffusion gradient, so each stage only gives a small percentage decrease of the "derichment" fraction.

Once you pass 50%, you stop looking for U-235 needles in a haystack to keep and start looking for U-238 needles in a haystack to throw away.

Comment · 8 days ago
Because then the distance between earth's pole and equator would no longer be 10,000 km.
Comment · 10 days ago
Florida has a problem with insurance fraud, which is what drives the rates up. If you can afford to self-insure, the expectation value of doing that is much better than the EV of using a commercial insurer (who has to price in the risk that you are an insurance fraudster)
Comment · 10 days ago
Maybe I’m misunderstanding your suggestion, but shares are already treated as ordinary income when they vest (when the shares are released to you and you first gain the right to sell them).

If a company pays you $1M of shares, the IRS treats it exactly the same as if you were paid $1M of cash and you used it to buy the shares. The capital gains work the same too: you pay capital gains tax on the difference in value between when you receive the shares and when you sell them. That’s how it already works.

Comment · 10 days ago
I thought it was obvious that I speaking about marginal use of government services.

When a billionaire moves to Wyoming, the marginal tax revenue is far greater than the marginal cost of police services, for example.

Comment · 10 days ago
A state can justify and sustain higher taxes on the wealthy by offering government services which indirectly benefit the wealthy (the externalities you mention). But it doesn’t follow that an arbitrarily poorly-ran government can sustain arbitrarily high taxes on the wealthy.

There’s some manifold of Pareto-optimal solutions to the problem of taxes and services.

California, for example, spends a lot of money to get not-great public schools, and has housing costs that are out of control. So if you’re importing new hires from other states, and pay them a lot to live here, and personally pay high taxes on top of that… that doesn’t seem like a Pareto-optimal point.

At some point, the wealthy will decide to move someplace that looks more Pareto-optimal. Better externalities, lower taxes, or both.

Comment · 10 days ago
The type of people who move from CA to WY for the tax benefits are the type of people who pay more taxes than they use in government services (even with very low tax rates). That means WY can offer more government services to the rest of its residents, making it more hospitable.

It is a fiscal detriment to CA and NY though.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton