dlkf

I mean, the matrices obviously change during training. I take it your point is that LLMs are trained once and then frozen, whereas humans continuously learn and adapt to their environment. I agree that this is a critical distinction. But it has nothing to do with “meaningful internal structure.”

> Previous generations of neural nets were kind of useless. Spotify ended up replacing their machine learning recommender with a simple system that would just recommend tracks that power listeners had already discovered.

“Previous generations of cars were useless because one guy rode a bike to work.” Pre-transformer neural nets were obviously useful. CNNs and RNNs were SOTA in most vision and audio processing tasks.

> Current AI systems have no internal structure that relates meaningfully to their functionality

In what sense is the relationship between neurons and human function more “meaningful” than the relationship between matrices and LLM function?

You’re correct that LLMs are probably a dead end with respect to AGI, but this is completely the wrong reason.

Now do drug-development.

If we did this fifty years ago, we’d be having this discussion by snail mail.

There is no epistemological collapse. Access to accurate information has never been so fast nor so easy. To be sure, lies are spread on the internet - but people believed all sorts of bullshit before the internet. Those who want to claim there is a crisis don’t have a principled argument as to how things are worse.

I implore everyone reading this to google the Sokal hoax before decide whether these guys are worthwhile.

Concrete Island by JG Ballard

Libra by Don Delilo

Deep Water by Patricia Highsmith

Assuming you value 10 days at the cost of 1-2 AC units.

The main difference is that the media report will be read.

Would new developments (or old developments that had gone underappreciated) in an adjacent stem field count as ”added cultural context” ?