trashtester

Joined 9 years ago

Karma
1,653
Submissions
1,438
Member since
Aug 31
View on Hacker News

Recent submissions

Comment · 9 months ago
The main problem with ice, is that it moves all the time. The glaciers on Iceland move up to 46m per day. Also, any tunnel created in fast moving ice could easily be crushed by the pressure of the ice.
Comment · 11 months ago
Indeed. But most instincts involve elements of learning. Meaning the instincts may be stored using a much smaller number of bits than if they were stored as traditional IF-THEN-ELSE computer program.

For instance, the pattern the brain seeks to optimize to learn to work may be much smaller than the full algorithm for walking.

And if the brain learns quickly enough (and if a newborn animal started learning elements such as balance, moving legs, etc, before even being born), learning to walk may be learned in minutes instead of months.

Comment · 11 months ago
For now, Sora will not be able to actually produce all the text, I think. Maybe next year.
Comment · 11 months ago
Student unions tend to focus on all sorts of other issues, I wouldn't trust them to handle cases like this.

The only way to reliably prevent the use of AI tools without punishing innocent students is to monitor the students while they work.

Schools can either do that by having essays be written on premise, either by hand or by using computers managed by the school.

But students that are worried that they will be targeted can also do this themselves, by setting up their phone to film them while working.

And if they do this, and the teacher tries to punish someone who can prove they wrote the essay themselves, either the teacher or the school should hopefully learn that such tools can't be trusted.

Comment · 11 months ago
Certainly, and I don't think anyone really doubts this.

Still, people are sometimes surprised by how DNA may affect more parts of behavior than they previously thought.

Not necessarily by directly coding for the behavior. In many cases, the DNA will just modulate how we learn from the environment. And if the environment is fairly constant, observed behavior can correlate more strongly with DNA that one might have expected.

Comment · 11 months ago
I don't think human DNA generally codes for the behavior derectly. Rather, DNA can code for how the brain learns from incoming data streams.

If the brain naturally tunes into some sources or patterns of input rather than others, it may learn very quickly from the preferred sources. And as long as those sources carry signals that are fairly invariant over time, it may seem like those signals are instinctual.

For instance, it may appear that humans learn to build relationships with kin (both parents and children) and friends, to build revenue streams (or gather food in more primitive societies) and reproduce.

Instead, the brain may come preloaded to generate brain chemicals when detecting certain stimuli. Like oxytocin near caregivers (as children) or small fluffy things (as adults). When exposed to parents/babies, this triggers. But it can also trigger around toys, pets, adopted children, etc.

Friendship-seeking can be, in part, related to seretonin-production in certain social situations. But may be hijacked by social media.

Revenue-seeking behavior can come from dopamin-stimulus from certain goal-optimzing situations. But may also be triggered by video games.

And the best known part: Reproductive behavior may primarily come from sexual arousal, and hijacked by porn or birth control.

Each of the above may be coded by a limited number of bytes of DNA, and it's really the learning algorithm combined with the data stream of natural environments that causes specific behaviors.

Comment · 11 months ago
As technology changes over history, governments tend to emerge that reflect the part of the population that can maintain a monopoly of violence.

In the Classical Period, it was the citizen soldiers of Rome and Greece, at least in the west. These produced the ancient republics and proto-democracies.

Later replaced by professional standing armies under people like Alexander and the Ceasars. This allowed kings and emperors.

In the Early to Mid Medieaval time, they were replaced by knights, elites who allowed a few men to defeat commoners many times their number. This caused feudalism.

Near the end of the period, pikes and crossbows and improved logistic systems shifted power back to central governments, primarily kings/emperors.

Then, with rifles, this swung the pendulum all the way back to citizen soldiers between the 18th and early 20th century, which brought back democracies and republics.

Now the pendulum is going in the opposite direction. Technology and capital distribution has already effectively moved a lot of power back to an oligarchic elite.

And if full AGI combined with robots more physically capable than humans, it can swing all the way. In principle a single monarch could gain monopoly of violence over an entire country.

Do not take for granted that our current undertanding of what the government is, is going to stay the same.

Some kind of merger between capital and power seems likely, where democratic elections quickly become completely obsolete.

Once the police and military have been mostly automated, I don't think our current system is going to last very long.

Comment · 1 year ago
Comment · 1 year ago
The "next token prediction" is a distraction. That's not where the interesting part of an AI model happens.

If you think of the tokenization near the end as a serializer, something like turning an object model into json, you get a better understanding. The interesting part of a an OOP program is not in the json, but what happens in memory before the json is created.

Likewise, the interesting parts of a neural net model, whether it's LLM's, AlphaProteo or some diffusion based video model, happen in the steps that operate in their latent space, which is in many ways similar to our subconscious thinking.

In those layers, the AI models detect deeper and deeper patterns of reality. Much deeper than the surface pattern of the text, images, video etc used to train them. Also, many of these patterns generalize when different modalities are combined.

From this latent space, you can "serialize" outputs in several different ways. Text is one, image/video another. For now, the latent spaces are not general enough to do all equally well, instead models are created that specialize on one modality.

I think the step to AGI does not require throwing a lot more compute into the models, but rather to have them straddle multiple modalities better, in particular, these:

- Physical world modelling at the level of Veo3 (possibly with some lessons from self driving or robotics model for elements like object permananence and perception) - Symbolic processing of the best LLM's. - Ability to be goal oriented and iterate towards a goal, similar to the Alpha* family of systems - Optionally: Optimized for the use of a few specific tools, including a humanoid robot.

Once all of these are integrated into the same latent space, I think we basically have what it takes to replace most human thought.

Comment · 1 year ago
For now, the people able to glue all the necessary ingredients together are the same ones who can understand the output if they drill into it.

Indeed, these may be the last ones to be fired, as they can become efficient enough to do the jobs of everyone else one day.

Comment · 1 year ago
Ironically, finding ways to spin stories like that IS one way of taking responsibility, even if it's only a way to take responsibility for the narratives that are created after things happen.

Because those narratives play an important role in the next outcome.

The error is when you expect them to play for your team. Most people will (at best) be on the same team as those they interact with directly on a typical day. Loyalty 2-3 steps down a chain of command tends to be mostly theoretic. That's just human nature.

So what happens when the "#¤% hts the fan, is that those near the top take responsbility for themselves, their families and their direct reports and managers first. Meaning they externalize damage to elsewhere, which would include "you and me".

Now this is baseline human nature. Indeed, this is what natural empathy dictates. Because empathy as an emotions is primarily triggered by those we interact with directly.

Exceptions exist. Some leaders really are idealists, governed more by the theories/principles they believe in than the basic human impulses.

But those are the minority, and this may aven be a sign of autism or something similar where empathy for oneself and one's immediate surrounding is disabled or toned down.

Comment · 1 year ago
It would not collapase. But it would shift some purchaing power from the middle class to the working class if all of them would leave, as working class salaries would go up even faster than the inflatino it would cause.
Comment · 1 year ago
Presidents may not be able to pardon themselves, but they ARE immune from prosecution through the regular legal system for any actions taken as part of the office as president.

The only way to go after them (given the current SCOTUS, who made the ruling above), is impeachment. And for that, the president has to do something so bad that 67 senators are willing to find the president guilty.

Comment · 1 year ago
Language models are closing the gaps that still remain at an amazing rate. There are still a few gaps, but if we consider what has happened just in the last year, and extrapolated 2-3 years out....
Comment · 1 year ago
If the training data had a lot of humans saying "I don't know", then the LLM's would too.

Humans don't and LLM's are essentially trained to resemble most humans.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton