pbohun

It would be much better to use LLMs to create ordinary programs than to use an LLM over and over to emulate something that's thousands or millions of times more efficient.

As an example, is it faster to multiply 2 numbers using a single MUL instruction or multiply matrices with millions (or billions) of elements multiple times? Multiply that overhead by every single thing you do and that's the overhead of using an LLM to emulate a program.

>Overall, nesformer runs 150–290× slower than the real console.

I like these kinds of projects because it helps to show the massive compute requirement between LLMs and ordinary programs.

A while back I saw some people saying we would just have LMMs hallucinate an entire operating system every single frame. I guess technically it's now proven to be technically possible, but it would be thousands of times slower while requiring thousands of times more compute (a multi-million x difference from an ordinary OS!).

Forget all the benchmarks, this is how you know a model is actually good.

Okay, that's some of the most impressive feats I've ever seen. Congratulations to the engineers!

The natural question from this is to ask if there's a way to create conditions where organs "become young" again. Of course, people have been trying to figure out aging for a long time, but this is encouraging that solving aging might be possible.

I think agents have the capability to multiply this problem times 10. It doesn't have to be that way though. I think a skilled person will create great software regardless of the tools they use.

Iryna Zarutska's killer had 14 prior arrests. There are many examples of people having dozens of arrests for violence before they murder someone. There are dozens videos of people taking trash bags into stores and wiping them out because "It's less than $1k". People's cars are broken into and things are stolen (while the cars are occupied!) and the police don't even respond.

There's not some mystery about who is doing crime. They're arrested all the time and let go! If we simply prosecuted the people who are arrested crime would fall by 90% over night.

This is so cool! I mean, we really wouldn't need it if we had 100% ipv6 (no cgnat), but this is the next best thing. I think people underestimate the innovation that could happen if we had trivial p2p.

I feel the same way. I think the difference is that new tech used to be an improvement to your life. New tech is there simply to suck life (your attention) and money away from you.

There are exceptions of course, But the general trend is worrying.

An idea I've played around with in the past is to have some sort of law that limits how much revenue a company can make from ads. For example, a law that says "A company cannot make more than 10% of its gross revenue from ads or selling customer data".

This kind of law would wreak havoc for certain companies (and content creators). However, just like prediction markets, ads distort and ruin the very thing they are trying to optimize.