cmrdporcupine

Yep, working class people's lives have sucked after 2008, though it was a continuation of a longer trend and is still continuing. (And COVID made it worse. All us tech people sitting comfortable in our home office while mass wealth transfer happened out of blue collar pockets...)

Worth remembering... Anti-globalization and anti-liberalization were slogans and policies of the socialist left in the late 90s and 2000s. Battle of Seattle, Occupy, etc. Voices marginalized and mocked by the neo-liberal centrist "left" (not left) in the Democratic party, Labour party, mainstream European govt's, Canadian Liberal party, etc. Manufacturing jobs were dumped overseas, union membership declined, middle class incomes plummeted, 2008 drained people's financial well being, while housing prices skyrocketed etc. And same "moderate" forces also went to war in the middle east, etc. etc.

Obama ran on left populist slogans but actually governed from the neo-liberal centrist right.

Actual socialist left voices and formerly moderate social democratic policies generally had no voice or power in government anywhere, Corbyn was run out of the room, Bernie isolated, etc.

So it's no surprise that the right and far right saw the vacancy and exploited it. The rise of Trump, of UK Reform, etc. ties directly into this sense of hopelessness and anger people had.

Now the "conservative" right -- which was formerly pushing liberalization the strongest -- talks in angry tones about "globalism" instead of "globalization", and it's caught up with anti-Semitic dog whistles, national chauvinism, etc. etc. That shit sells.

So? Mark Carney is to the right of the centre by the standards of the G7. Just slashed corporate taxes, environmental regulations, doing privatization, federal service layoffs, and slashing labour rights. Only looks "left wing" to culture warriors. Sits right in the centre of European politics, same vibe as the CDU in Germany or Macron in France.

There's nothing "far left" about the provincial NDP parties. They're centrist neo-Keynesians, pretty pragmatic, they don't even call themselves socialists. Again, it's only smelling "far left" if you're obsessed with cultural politics or "woke" stuff and are frankly politically illiterate and never taken a basic political science intro course? I didn't seeing Eby nationalizing/socializing industries and crap. "Far left" is such a bizarre characterization that it boggles the mind.

The federal party goes through phases of more old school NDP/CCF social democracy. But never governs, so.

"far left"

OMG. Peak hackernews comment.

My experience is: The LLM fails to "understand" or "intuit" who the audience is. It tends to reward its own recent context and its interaction with the prompt writer, rather than "considering" documents from the viewpoint of a hypothetical reader. You can often prompt them to go more in that direction but it gets tiresome.

The best approach is just to write the outline and initial text in a very messy fashion yourself. And then have it clean it up and add detail. And then edit again by hand.

All of this can be true without stupidly calling it "state sponsored."

The US mainstream media is equally stupid -- "liberal" or "conservative" -- CNN or Fox both make me want to gouge my eyes out.

Those of us on the (real) left have been pointing out the problem with the broadcast media for decades. Concentration of ownership and private interests are the problem, and frankly the CBC is the least worst of the bunch here in the country.

Canada is currently under a mass nationalist fervour under which the Carney gov't is getting away with a lot. The thing is the stuff he is getting away with... is exactly the stuff the Conservatives also wanted to do anyways. So people on the right frothing at the mouth about the liberals just baffles me. He is literally implementing the full CPC platform from the last election.

It has the same problem that the US has, which is it is stuck in a two party duopoly, with both major parties sharing fundamentally the same political economic outlook. Just with different takes on culture wars stuff.

The only significant opposition to this bill has been coming from the NDP, which was decimated to a small number of seats by people piling into the Liberals because of nationalism and by its previous pathetic fealty to the Liberals in the last two parliaments.

what are you even on about, this is complete nonsense

nevermind half the population doesn't even pay attention to traditional "the media" these days

the bulk of "the media" in Canada is US owned, not "state funded" (which is only the CBC) and I haven't gotten any particular pro-vibes around this bill from them

Yep, and often actually very expensive to use. More expensive than the frontier models because there's no realistic coding plan.

Anybody could fire up vLLM now to do exactly what you're talking about. And they do? There's dozens of places hosting DS4.1 Flash, at good speeds. So I'm not sure what your point is.

What this provides is the give contributors to vLLM, sglang, etc. a reference implementation of some of DeepSeek's own hard-won inference serving techniques.

No doubt we'll see patches to vLLM inspired by bits in here.

Not sure why you're being downvoted. It's very clear to me in the order that even the open weights would be forbidden, even served through vllm or sglang etc.

It's not US labs that it targets, but just US gov't civilian agencies.

... so far.

I don't see how this proposition holds. It's just part of an inference engine for serving DS4.1 Flash. Which vLLM and SGlang can already do. Less efficiently, I'm sure, but on much broader hardware, and with other models in the mix.

People will take the novel bits here and port them to the above. The community as a whole will benefit. Including infrastructure engineers inside OpenAI and Anthropic.

But a lot of what's in here is already in published papers out of DeepSeek already.

I mean, memory prices are high. They ain't getting cheaper. And KVCache is held in memory. The more people are using cache, the more memory you need. It's not free to cache it.

Plus there's complicated cluster-wide KVCache distribution schemes, built around RDMA networking, etc etc.

By far the most expensive hardware cost now of inference is the memory cost. KVCache is still using it. Though obv GPU compute is using more energy

It's not just like... "stick it in Redis, all done!"

If it's anything like my DGX Spark, the "premium" is almost 100% just the memory cost, not the GPU or ARM core.

10 months ago when I got my Spark it was competitive in price with a similarly spec'd out Mac Studio. As RAM prices have gone even more parabolic, so has its price. And so has the Mac's. And the Strix Halo competitors.