reliablereason

Ads don't necessarily work through the use of "reason".

They work because you are infinity percent more likely to buy something you know exists vs something you don't know exists.

Right if it was literally the processing they make the claim about and not the molecular ingredients. Then they basically have a result that points to there being something fundamentally wrong with our model of physics.

You cant have a non mediated cause according to our current model of physics.

The title of the article is irresponsibly chosen.

- My time in the field of psychology has made me think that the use of imprecise language for describing psychology has a large and problematic societal impact

ADHD is correlated with but is NOT a "circadian rhythm disorder". This is definitionally true.

There are many causes of ADHD. One of them is likely sleep issues.

When i look at the things said by LLMs i clearly see stuff that i would call reasoning.

Its reasoning does however have certain "bugs" that a humans reasoning would never have.

My guess is that much of those bugs appear cause the reasoning that a LLM does is not itself built on a self stabilised system. In humans you get coupling between levels of self stability which acts as a constraint, stabilising the system even more. The next level being predictive coding modelling the world. There is no next level in a LLM; they are trained as refiners in teacher forcing mode, a paradigm where self stabilisation is not a driving factor.

Dont be fooled. Reasoning does not happen in the prediction of the next token, it happens virtually in the text that is created.

The next token prediction is just "the hardware" following the underlying rules. Like the basic set of rules.. in a sense similar to how the "game of life" does not really contain gliders. Gliders are just a self stabilised system that arrises from the simple rules.

Clearly.. this is not some new revelation, it has been the default assumption for a very long time, probably over a hundred years.

Damage to the hind brain results in behavioural changes that are blatantly different compared to when the "newer" parts of the brain is damaged. The cerebellum literally even has a different color.

Biological minds in biological organisms are self referential in the way that you have a neural network that forms a model of the world. That model then "discovers" that it is "it self a part of the world" so it tries to model that part of the world (model it self). In this way some type of self referential "awareness" (or whatever you want to call it) is formed. That self model that contains awareness is then used to guide organisms behaviour. Causal Transformer LLMs don't work in this way, they have theoretical knowledge that they exist but its selfhood is not in this described way built on the self modelling that biological brains do.

All this being an empirically unproven theory/hypothesis. But an extremely strong one (if you ask me).

It's likely/It could be an effect of more reinforcement learning in training compared to earlier. You need loots of RL to learn to code well.

(1) LLMs collapse and start outputting garbage after a number of tokens if you do not sample and just pick the "best token" each time. This is a consequence of how they are trained.

Interesting topic. That said I don't know how useful this is since LLMs are primarily trained using mode-covering training rather than Mode-seeking(RL) training, which means LLMs can not form (and does not have) the same underlying structure to their models of language that humans have.

A LLM does not learn topic by topic, it learns everything all at once and slowly integrates it in to a single knowledge system.

Yes there is. The use of Gödel numbers to represent a system that contain itself is infinite regression.

Gödels incompleteness is just an example of the fact that you cant determine the outcome of infinite regression (in the general case).

The same as me asking you to give me the last digit of pi.

I am a bit annoyed by pop science always twisting it to sound so convoluted.

I would think coaxial designs suffer as the lower rotor works in more turbulent non laminar air.

That would "using reason in chain of thought".