solardev

It seems like I can't help myself and keep sliding back into old habits without realizing. I am sorry, I will think twice next time.

I don't think so — I don't disagree with you there. It was more the parent (the child to your post) I was responding to, about statistics and semantics.

Lol, that's actually kinda cool. Did you get any interesting Eastern responses to your diary entries?

I'm imagining something like...

> Dear diary, I got bullied again today, and the bread was stale in my PB&J :(

>> My son, remember this: The one who mocks others wounds his own virtue. The one who suffers mockery must guard his heart. To endure without hatred is strength; to strike without cause is disgrace. The noble one corrects himself first, then the world will follow.

I don't think this is the unprovable you think it is?

If LLMs and statistics can't encode semantics, how can do chatbots perform long-form translations with appropriate contexts? How do codebreakers use statistics to break an adversary's communications?

Sometimes the statistics are semantic, like when "orange" and "arancia" the picture of that fruit all mean the same thing, but Orange the wireless carrier and orange the color are different. Those are connections/probabilities humans also learn via repeated exposure in different contexts.

I'm not arguing that LLMs are synthesizing new ideas (or old ones), but that they ARE capable of deriving semantic meaning from statistics. Rather than:

> language, based solely on statistical data, shorn of semantics

Isn't it more like:

> language, based solely on statistical data, with meanings emerging from clusters in the data

Wasn't that before the era of hyperscalers? Intel offers nothing of value anymore. What's to stop one for the giants from just swallowing them up like 3dfx or ATI?

Can you prove that statistics cannot encode semantics?

Will Intel even be around in a few years to support this thing, especially in software? They seem to be in their death spasms...

It's only illegal when the insufficiently rich do it.

How does the masseur survive that massage?

I actually forgot that site existed until you mentioned it... ChatGPT had 100% replaced it for me. I don't miss SO's terrible moderation at all.