danmaz74

An expression that stuck with me from the Domain Driven Design book is "supple design". Achieving supple design (and thus supple code) is a goal, but it doesn't come for free - it requires a lot of work. I'm trying hard to get agents to create supple design - or at least not to make my own designs less supple - but it's not easy, because they have a tendency at overcomplicating and overengineering code.

The trade-off between quality and speed of development has always been a tenet of software engineering. Agentic coding changes the equation a lot, but the equation is still there.

By that analogy, Anthropic is doing more like 0.000001% of the work of learning all we learned, and writing it down so that Anthropic at al can condense it into their models.

Higher TPS by itself wouldn't remove the humans in the loop. Humans in the loop aren't there to make things faster, but to make them right - current LLMs can't do that on their own in most real world projects.

On the contrary, I would say that higher TPS would make humans in the loop much more productive, because the current long wait times mean that you lose focus and flow.

A US-led NATO may very well not survive two more years of Trump presidency.

T-bills are offering higher yields, that helps with demand.

This is pretty a common misconception. Schengen area only refers to the fact that there are no border checks between two countries which are in that area - it's just like an internal movement. This applies to anybody, so for example if a Canadian enters the Schengen area, they can move to any other country within that area without checks and without requiring an additional visa.

What you're thinking about is the "single market" - which, even if the name could deceive, also applies to people, including the right to go work anywhere within the single market for citizens of single market countries. Which is what many brits always hated, as they wanted single market for services and goods, but not for people.

Single market doesn't imply Schengen though - eg I as an EU citizen have the right to move to Ireland for work, but I still need to go through border checks as Ireland is outside of Schengen (because they have free movement with NI).

Schengen looks like a stretch, considering the geographic situation, but free movement is achievable, if both want it.

As someone who is very much in favor of this, let's remember that for now we're only at the announcements level. Any binding changes in the EU require a long process - if anything else, because there are 27 member states, each of which have veto power. But I'm hopeful that facts will follow these announcements.

At this stage it's not about how much it's worth, but how much investment is required to reach their goals.

Yes, that could be a way to achieve that. After all, even humans have short term and long term memory, and it looks like sleep is a very important "tick" to connect the two, so it's not all just continuous.

For sure, doing it for all users would be economically unfeasible. I wonder if the labs are experimenting with something similar, though.

I have no idea about timelines, but the current LLM architecture has no mechanism which could emulate online learning in a way similar to how it happens in humans and other animals. As another commenter wrote, there is no neuroplasticity while these systems interact with their environment in normal usage; adding information/constraints to the context partially mitigates this, but it's a completely different mechanism.

The RL phase is the most similar mechanism I know of that comes to my mind, but I'm not sure it could be adapted to fill that gap.

My totally unsubstantiated theory is that this is the missing link towards what most humans would consider AGI. I don't see this as intractable, but it may require some substantial change in architecture.

Given how important matrix multiplication with a huge number of fixed parameters is becoming, there is an enormous incentive to design much more efficient architectures where this very simple compute is colocated with memory. Inference cost would come down a lot.

Yes, but that should be on a case by case basis. Blocking everybody is just an ideologically stupid choice, besides being inhumane.

Memory fabs take years to build, they cost a lot and there is no guarantee that the demand will stay as high years in the future. It's all very complex.