Tuna-Fish

Too bad for all the horrible misfeatures that got designed in and that we still have to live with, like the entire I/O Manager/Object Manager/filters/driver stack mess, with no caching anywhere above the drivers.

Distilling just works too well. It costs much more to aggregate the data in the first place and train the first model, but once that exists and you are selling access, the second guy can train their model by using the first model to generate the training data.

The only ways to fight this is trying to either: 1. Block it by cutting off access, which is pretty tough because it basically means you cannot offer unmonitored access which is a no-no to a lot of customers, and even then the workload looks very similar to actual real workloads and if the company doing the distilling is a bit sneaky and using intermediaries etc it's almost impossible to stop, or:

2. Try to use IP law to block the practice, which is pretty gross given how they got the data in the first place, and so far no court has supported them on this. And even if they can make it illegal, it won't actually help because there are countries that see having top-tier AI as a national priority and will actually support their companies breaking laws to get there.

People misunderstand why Anthropic is being so stingy about granting access to their top models. It's not some kind of marketing ploy, they know that if they release them fully openly then there will be a Chinese open-weights model in 3 months that is just as good. Also the reason why they try to hide chain-of-thought and the probability distributions.

SRAM is not very dense.

IMO the next big shift in AI hardware is when some of the upcoming logic-compatible memory types mature. Inference inherently likes many small local pools of memory, with their own interface each. This is impractical with currently available memory other than sram.

it's the widening (for example: fp16 * fp16 = fp32) instructions, which are useful on some loads.

What's actually used is banks of old, used phones with broken screens, controlled via usb. They can be had for rather cheap.

They care tremendously about virtualization security, when the threat model is one of their tenants attacking another one of their tenants.

They care not one bit about virtualization security when the threat model is themselves attacking one of their tenants.

One of the 384-bit keys was literally 4. All of them fit in a byte.

Yes, it more efficiently utilizes the land. But, if you are not the person who owns the plot that gets developed, more housing being built next to you harms you.

Vulnerabilities are typically fixed, and then reported.

The "hypothetical people" are in actuality all the other voters in your country. Lots of people are "pro-development, just anti-development near themselves".

Do you think that the Japanese system where permitting is centralized away from local government antidemocratic?

Yet less than 20% of the 80+ major vulnerabilities in confidential computing have been found by cloud companies, with the majority being found by universities and independent researchers.

It's not actually in their interest to look too closely. They know they are selling snake oil, and they do not care if it works. The only function of the technology, as far as they are concerned, is to be something they can market to customers who are scared at running on public cloud, and either they never intend to exploit it, in which case it doesn't matter if it doesn't work, or they do, in which case they don't want the vulnerabilities to be found and fixed. Either way, there is no upside to them for going spelunking.

> I think homeowners are too close to the problem to make rational choices.

The homeowners are making rational choices. That's the problem. As the most expensive asset a typical homeowner will ever own is their home, it makes rational sense for them to support any policy that supports it's value and oppose any policy that undermines it's value. Building more housing undermines it's value.

And this is why the local community absolutely should not have any more say about a new development than a hypothetical someone who would like to live there, but can't, because there is no available housing.

It doesn't need to run indefinitely. I don't think anyone sane thinks it's going to run indefinitely. It just needs to run long enough. Moore's law was what, 50 years? If AI keeps improving at the rate it currently is for 20 years, the world will be very different when that curve flattens out, in a way that makes most of our current concerns are entirely irrelevant.

AFAIK, there has never been a memory encryption scheme that successfully protects the VM client from the hypervisor, they've all been found to be defective within a few years on the market.

It is probably an useful layer because some of the attacks are not feasible for a remote attacker who has compromised the host but require actual physical access. But the marketing spiel of protecting your data from Amazon itself is just lies, physical access is more powerful than root access, no exceptions.