mtdewcmu

Joined 14 years ago

Karma
1,439
Submissions
1,296
Member since
Jul 19
View on Hacker News

Recent submissions

Comment · 4 months ago
Looks like the hardware this runs on has only 64 KB RAM.
Comment · 4 months ago
I think that the common meaning of AI has changed since this was written. This book was written at least 14 years ago, long before anyone had heard of an LLM. Matt Mahoney incorporated neural networks in his compressors. Afaik they weren't pretrained. They were adaptive and made one pass over the plaintext, simultaneously learning and predicting. Decoding worked similarly.

If you go and (re)read what he writes in relation to AI, which I just did, it's about exclusion. He excludes "Universal Compression" as impossible, Kolmogorov compression as uncomputable, and then he gets to Artificial Intelligence. Artificial Intelligence is an appropriate way to model data, since data is created by humans with human intelligence. And, AI doesn't violate mathematics the way Universal Compression and Kolmogorov solutions do. So therefore, Artificial Intelligence is what's left. That seems to be the argument.

Comment · 4 months ago
Really nice guy, also.
Comment · 4 months ago
When decompressing, you need to reproduce the output of the LLM exactly as it was during compression, otherwise the decompressor would output gibberish. Can you count on the LLM being that consistent?
Comment · 4 months ago
Comment · 4 months ago
Is sel4 an OS kernel created by Jane Street?
Comment · 5 months ago
>> Retatrutide is incredible in a mind altering way

>> and all just love the way it makes you feel

Maybe it will turn out to be an antidepressant as well. That would be quite a coup.

Comment · 7 months ago
You could write imperative code in Racket without much difficulty, as long as you don't mind the exclamation points.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton