DSingularity

Its 256k context window. Quantization is orthogonal. We cant really tell directly so it could be quantized.

He’s explaining that the magic is baked into the harness. It’s the prompts as much as it is the model.

It’s unlikely to stop here. Today is a proprietary 5T parameter model, tomorrow it’s 5 100B parameter models that each specialize to specific applications and you can run them on your phone. The direction of travel is not like you think. The real victim will be medium to large software companies that can no longer rely on the difficulty of reproducing or maintaining or hosting their software as moat.

Once you notice the pattern of how these companies are started you will see that there is a hidden hand of government behind much of what we think is an independent, market driven, capitalistic enterprise. Whether it’s Facebook or Oracle or Palantir or SpaceX it’s all the same. Heck even the founding of Silicon Valley itself can be viewed to be government driven. The bottom line is national security is not going to be left to the whims of a market when the pentagon has a black budget that can eclipse all of VC spending with the stroke of a generals pen.

I think these things can be equivalent. It all depends on the definition of wait.

The simple example can be x86 with monitor/mwait instructions. These will suspend a hardware thread until it can be awoken when the memory write happens to the monitored address. Nothing happens on that cpu thread in the meanwhile. Yet at the same time if things are being virtualized the higher authority exists and it can do something else with the CPU until the write. Same for OS type of event synchronization like Linux futex.

I would argue that the wait abstraction is more powerful. The alternative isn’t powerful enough to enable these kinds of “wake me when I can be useful again” behaviors.

Of course that is logical but you really should learn to distrust your logic. Logic can easily end up leading you to antisemitic ideas. Same with humanitarian ideas about Palestinians and such. It’s best if you just let the Zionists do as they will without any criticism.

How antisemitic. You aren’t allowed to critique them. Yes even if they rape their prisoners and defend their rapists in parliament and on TV.

The good people of israel? You mean the citizen army that carried out the genocide? I am sure they really hate their government but probably because they think its not doing enough.

Thank you!

nope. I cant upvote it either. @dang

This take makes even more sense when you consider the costs of making a move to create the market. The organizational energy and its necessary loss in focus and resources limits their ability to experiment. Arguably the best strategy for Google: (1) build foundational depth in research and infrastructure that would be impossible for competition to quickly replicate (2) wait for the market to present a clear new opportunity for you (3) capture it decisively by focusing and exploiting every foundational advantage Google was able to build.

Why do you start a startup? Is it to build an idea you believe in and believe it is potentially lucrative or is it so you can go through the motions, say the trendy things, and get outcompeted because in the end you are primarily focused on getting acquired with a 1B exit?

Of course that’s possible — but the context matters doesn’t it? You know - the overthrow of the democratically elected government in Iran because it wasn’t sufficiently pro-west? The installation of a brutal shah who eventually got overthrown in a popular revolution and all the subsequent attempts to attack Iran and overthrow its government (by the CIA and Mossad) — this is all important context.

We can all have our ideological preferences (democracy, socialism, free-market capitalism, etc) but geopolitics does not operate in the world of ideals — there are adversarial relationships that force governments to act in a certain way in order to remain sovereign.

Zionists want to rewrite history so we can all ignore the long list of grievances the Iranians have with the west (Israel in particular) and instead operate in a false reality where the only criminals are the Iranian. The bottom line is you can’t spend decades savagely attacking a nation to undermine its government (because you don’t like their policies ) and then expect to easily paint the government as the evil ones as they fight for survival with the kind of brutality you can expect from a government that has its back to the wall. We all saw you wage economic war with sanctions. We saw you block medicine and food. We saw you assassinate their intellectuals and academics. We saw you bomb their embassies and assassinate their leaders. We can dislike the brutal Islamic dictatorship but we know who is the greater evil — the Zionist hypocrisy doesn’t go far with the free people in this world.