neurologic

The novelty of GPT3 is its few shot learning capabilities. GPT3 shows a new, previously-unknown, and, most importantly, extremely useful property of very large transformers trained on text -- that they can learn to do new things quickly. There isn't any ML researcher on record who predicted it.

> Also, I don't really get the societal penalty for disaster preparation.

It makes a lot of sense: if you're preparing for a disaster, you won't go down with everyone else when disaster strikes. This creates some feeling of resentment which caused people to lash out at you.

It looks this way, which means that military and police intervention is what we'll get.

(off by a factor 15)

No, it's 200 PFLOPs:

> Built for the U.S. Department of Energy, this is a machine designed to tackle the grand challenges of our time. It will accelerate the work of the world’s best scientists in high-energy physics, materials discovery, healthcare and more, with the ability to crank out 200 petaflops of computing power to high-precision scientific simulations.

EDIT: OK, it's 200 PFLOPs of high precision math, 3 EFLOPs of lower precision math. I take my comment back.

This supercomputer is surprisingly underwhelming, since it's equivalent to just two of Google's TPU v3 pods.

Statistics [edit: and especially ML] is different from math. It is important to let go of one's preconceived notions and to try to absorb the new field as is. Its jargon exists for a reason --- the normal math jargon doesn't quite have the right concepts --- so it is worthwhile spending the effort to understand it.