mtlb

The most important thing is to figure out what you want to achieve. Banal, easier said than done, but always important to keep in mind. Your goals and understanding of them are likely to change, but having more understanding is always better than having less. This understanding can only be gained through practice, and is personal to you, which makes it hard to give specific advice.

CS is not really a field that can be mastered as a skill. The skill sets of people developing web services, games, robots, programming languages, hardware architectures, and software that runs on space shuttles will be somewhat different. There are also purely theoretical and mathematical aspects: algorithms and data structures, type theory, formalized logics, etc, etc. All of those have their own resources and communities.

There are some general things that would be good to know for anyone working on anything CS-related. Check out a few computer science courses in big universities, and the things they all teach in first and second years would be the most universal ones.

As for the practical stuff you can do right now: for engineering aspect, I would recommend picking a simple project (website/app/game) and implementing it end-to-end using best practices you can find for everything: code style, testing, repo, CI/CD, and so on. For theoretical aspect you can check out Project Euler and see how far you can go in solving the challenges on there.

And I wish you best of luck on your quest.

I see the issue in fixing the errors automatically in that "fixing the error" is another aspect of "changing the behavior of the program" (even on the syntactic level: how would you fix a line "x = (2+3-4*5;"?), and we likely don’t want random changes to this behavior to happen. The article says that for self-healing of code to work, you need to have a full specification of what it should do, e.g. in the form of test cases that check for every scenario. But if you cover every possible scenario in your test cases, then how can a program have an error to fix to begin with?

If such tests have been written, then writing a program satisfying all of them is definitely a solvable problem. But now the entire complexity of writing good code turns into complexity of writing good tests.

I think that generally people are interested in being as intelligent as possible. The institutes of school and university, the study of pedagogy and science in general are all dedicated to this.

The reason why people generally don’t strive to have supernormal abilities such as super memory is because these are not strictly needed. Instead of memorizing everything we can write it all down.

Some abilities are much more useful, but we don’t know what makes them appear. Neuroscience and psychology are studying the underlying mechanisms for those. These topics are just very hard to understand, and would be much harder to reliably implement in practice. For example, we understand a lot more about how muscles work than how brains work, yet most we can do to affect our strength reliably is better nutrition and exercise programs. And until we find a way to make everyone run ultra-fast without impeding other positive qualities, a bicycle would be preferred to running very fast.

If the improvement in human intelligence could only be done mechanically (i.e. by making the brain work faster or store more stuff more precisely), the sciences about human mind would be the only sciences that improve human intelligence. However, all sciences work on this. A person who studied Newtonian mechanics would be "superintelligent" in reasoning about motion of rigid bodies compared to people who don’t know about it. Being able to masterfully solve hard equations is not be as useful to humanity as a whole as devising formulas to make solving these equations easier for everyone, and computing machines to let them be solved automatically.

The entire economy will be based on blockchain currencies and NFTs. I know it was supposed to happen last year, but we just need to wait a little more...

You are not wrong, but too abstract. Saying that brain is statistical and therefore can be represented with statistical model such as artificial neural net is like saying that brain is computational and therefore can be represented with a Turing-complete system, or that brain is physical and can be represented via physical simulation, etc.

The biological neural structures that encode behavior are “trained” through evolution, but even the most advanced animals rely mostly on conditioned (= learned during lifetime) reflexes, and not on the ones “hardcoded” evolutionary.

Certainly not much evolutionary “training” in the human brain has happened in the last 3000 years, yet advancement in our understanding of the world has been plentiful. But human thinking (including rationality, mathematics, etc.) is on a different level to even learned animalistic behavior. Some great apes were taught language and even showed basic abstract conceptual thinking, but were never able to reach the level of 3-5 years old human kids.

The problem with GPTs and other statistical models is that they can learn incredibly complex patterns in anything we can express as bytes, but not learn the simplest concepts of maths despite being trained on the whole corpus of mathematical texts available on the internet, while kids need classes that can be covered in a single textbook to understand them, and adults may need just a textbook for this.

>Imagine how fast you could think if you had a mentally stable whiteboard that you could perceive as clearly as you can see, and update as fast as you can think the changes.

Thinking about what I am going to draw or write on the whiteboard takes the bulk of time, not the act of drawing or writing. The "update as fast as you can think" part will likely be achieved soon with neural interface, yet it's hard to imagine that this will lead to "superintelligence" of some sort. Same for "mental file cabinets": real or digital files allow to trivially store information, and search systems allow to retrieve it pretty quickly, yet somehow Google didn't make everyone who can use it super smart.

Same goes for vocal speed: coming up with the words to describe the idea and coming up with the idea itself are different things, second being much more hard.

> At this point, IMHO, anyone pessimistic about AI has expectations far behind the exponential curve we are in.

The problem is that the crucial aspect of reasoning is missing in the state of the art models right now. We can make LLMs write to and read from files, but as long as there is a chance that any of its output will be incoherent (and there's a good of this chance now) and there is no mechanism to actually check for errors logically, the whole whiteboard architecture will be a huge demonstration of "garbage in, garbage out".

They are "capable", but only by chance. If you generate millions of random sentences in a human language then some of them would express some "useful new solutions". LLMs would have a higher chance of this happening as they generate sentences that are statistically more probable and therefore more likely to represent a coherent thought, but this would still be a chance.

> These cases are obvious to us because the brain has access to much fancier causal reasoning than what we can currently express in human language. For now, human language is stuck with "If a then not b" stuff.

I don't follow this. Didn't you just express these cases in human language? I understand that in reality we can "grasp" the meaning of a problem of not being able to open the door without expressing or thinking about it verbally, which would be redundant as there would be a lot to say (the key may be broken, the door may be held by someone on the other side, even if the key works we might be trying to push instead of pull, etc, etc.) and any person who has opened doors with keys would likely understand all of this. The problem is not that those things can't be expressed in human language, but the lack of ability to build good conceptual models of the world that encompasses all such knowledge and allows reasoning on it quickly.

Is there a conceptual difference between the categorical database and hypergraph database?

Yeah, the "logical reasoning" in LLMs is mostly a marketing device to get products sold and papers published. One could hope that starting with reasoning instead of trying to get it "emerge" would do a better job. But if we have little idea of how abstract thinking actually works, this is a problem. What do you think about current logic-based AI approaches? Do they try to replicate the best ideas we've got from congnitive sciences, or trying to do their job for them?

Thanks, modern rule engines and description logic formalisations are something for me to explore! Are there any other practical applications of such advanced SAT solvers?

Their previous model was better than 46% of such competitors (according to them), so 85% seems achievable by throwing more compute resources at typical ML training. After all, training on millions of examples of logical reasoning will undoubtedly store logical rules in the model in some shape or form (it does so even in ChatGPT), yet the results are still more "convincing" rather than "correct", or "probably correct" at best, usually achieved with lots of postprocessing on top. GPT-4 is better than 90% of lawers at the bar exam, yet still manages to fail at reasoning on much simpler domains.