SuchAnonMuchWow

262 if you include the flags of England, Scotland, and Wales, which for some reason are the only flags in their own separate blocs.

This is not a GPU, this is a laptop SoC with CPU and integrated GPU, and knowing nvidia it will probably be even more closed than an intel CPU. You will own even less of your hardware

I'm not completely sure, but are cloud versions of the distros actually recompiling the packages ?

I though it was mostly: "select a minimal set of packages needed for docker and co", not "recompile all the packages you want in your distro".

I though LWE and SVP were NP-hard. Doesn't breaking them mean NP is in BQP, and thus classical computer encryption is entirely broken with quantum computers ?

How would we recover from this back to the drawing board ?

Soldering dump a ton of heat into the cell, which has chances of destroying the cell. That's why most of the cells are spot-welded: its similar to soldering, but its much quicker and is localized only on the part of the metal that need to be melted, so the heat don't have time to reach the cell itself.

3. >> I was resounding told that the absolute error in the numbers are too small to be a problem. Frankly, I did not believe this.

> I would personally also tell that to the author. But there is a much more important reason why correct rounding would be a tremendous advantage: reproducibility.

This is also what the author want from his own experiences, but failed to realize/state explicitly: "People on different machines were seeing different patterns being generated which meant that it broke an aspect of our multiplayer game."

So yes, the reasons mentioned as a rationale for more accurate functions are in fact rationale for reproducibility across hardware and platforms. For example going from 1 ulp errors to 0.6 ulp errors would not help the author at all, but having reproducible behavior would (even with an increased worst case error).

Correctly rounded functions means the rounding error is the smallest possible, and as a consequence every implementation will always return exactly the same results: this is the main reason why people (and the author) advocates for correctly rounded implementations.

ARM have been moving away from chips with small area for a long time (see server SoC which are huge beasts), and are trying to become the standard platform for everyone trying to have custom hardware.

In this space, chiplets makes a lot of sense: you can have a compute chip with standard arm cores which is reused across your products, and add an extra chiplet with custom IPs depending on the product needs. That is for example what (as far as I'm aware) Huawei is doing: they reuse the chiplet with arm cores in different product, then add for example an IO+crypto die in the SoC in their routers/firewalls products, etc.

More than the ISA, its the memory interconnect that require standardization. At SoC level, ARM is already a de-facto standard (ACE-Lite, CHI, ...), but its only a standard for communication inside a chip, to interconnect varius IPs.

I guess this standard aim to keep being a standard interconnect even in multi-chiplets system, to create/extend the whole ecosystem around ARM partners.

In addition to the other comments, the iso C23 standard added the <stdbit.h> header to the standard library with a stdc_count_ones() function, so compiler support will become standard.

The article goes into great detail and gives several example of several CEOs borrowing for actual decades, so it passes the sniff test because it does actually happen.

Mathematicians already explored exactly what you describe: this is the difference between classical logic and intuitionistic logic:

In classical logic statements can be true in and of themselves even if there as no proof of it, but in intuitionistic logic statements are true only if there is a proof of it: the proof is the cause for the statement to be true.

In intuitionistic logic, things are not as simple as "either there is a cow in the field, or there is none" because as you said, for the knowledge of "a cow is in the field" to be true, you need a proof of it. It brings lots of nuance, for example "there isn't no cow in the field" is a weaker knowledge than "there is a cow in the field".

The goal of this type of quantization is to move the multiplication by the fp32 rescale factor outside of the dot-product accumulation.

So the multiplications+additions are done on fp8/int8/int4/whatever (when the hardware support those operators of course) and accumulated in a fp32 or similar, and only the final accumulator is multiplied by the rescale factor in fp32.

Its worse than that: the energy gains are when comparing computations made with fp32, but for fp8 the multipliers are really tiny and the adder/shifters represent a largest part of the operators (energy-wise and area-wise) and this paper will only have small gains.

On fp8, the estimated gate count of fp8 multipliers is 296 vs. 157 with their technique, so the power gain on the multipliers will be much lower (50% would be a more reasonable estimation), but again for fp8 the additions in the dot products are a large part of the operations.

Overall, its really disingenuous to claim 80% power gain and small drop in accuracy, when the power gain is only for fp32 operations and the small drop in accuracy is only for fp8 operators. They don't analyze the accuracy drop in fp32, and don't present the power saved for fp8 dot product.