bdg

I wonder if going the other way, maxing out semantic density per token, would improve LLM ability (perhaps even cost).

We use naturally evolved human languages for most of the training, and programming follows that logic to some degree, but what if the LLMs were working in a highly complex information dense company like Ithkuil? If it stumbles on BF, what happens with the other extreme?

Or was this result really about the sparse training data?

Leading is an imperfect predictor for the change we actually care about. Lagging is a late confirmer.

Hours worked is an imperfect predictor of output in a factory. Widgets delivered is a late confirmer. Leading and lagging indicators for productivity.

This requires a preset architecture standard that explains specifically what boxes and arrows are, and how boxes/arrows interact. Lots of software smears a logical box out over several folders in the code, sometimes even with entirely different names. I don't just mean people write non-cohesive code, I mean frameworks tend to prefer organisation by layer ("the views go in the view folder!") instead of organisation by module ("These things work and change together with a defined boundary").

You can have what you're asking for if you agree to a predefined architecture and everyone agrees to write code that way.

Honestly we have the same problem outside of engineering. C4 is really just a way to focus conversations along one level of abstraction.

How many times have you talked to someone who bounces up and down from high detail high complexity to zoomed-out simplicity in the same thought, and not understood what they wanted to tell you? We have the same issue when devs think "I will just yolo some boxes and arrows on this board, it makes sense in my head so it is a good diagram!"

Having structured architecture conventions becomes more important when you have many architecture conversations across multiple people and would like to gain insights from the diagrams too.

The code-model gap is why we don't have this.

You don't organize code the way you mentally model it in many projects, and nearly all languages lack a way to solve this. Annotating code is prone to the same issue as keeping a diagram up to date, and the same issue as keeping comments or documentation up to date.

There is a medium-to-weak argument that enforcing these minimum standards even in clearly benign places raises standards everywhere, which means it is much less likely to show up in the really bad places.

I'm just making debate however, I don't think most people are playing 3d chess when they ask for these changes, they just want the line item on their report to clear up.

When I meet someone with two PhDs in Europe I started to evaluate if they're contributing massive brain-blasts to civilization or if they just wanted to delay the next chapter of adulthood and use free education as a camouflage.

I have to say I feel like there's a lot of comments in this thread that are just totally detached from reality. I moved from Toronto to Berlin in 2017 and a lot of comments in here about living in fear of Muslims is just ... I don't know what part of Germany you are living in, and I visited a lot of it. I went to Karnival in Köln, and small beer festivals in the Bavarian countryside, I talk to locals in every city I go to.

I do however distinctly remember that when I lived in Toronto my social media feed was absolutely polluted with hype about how refugees are taking over Europe and the migrants are everywhere and there are countless no-go zones and endless rapes and the end of Europe was imminent.

Then I moved here, and literally not even once have I seen or felt any of that. I have however seen the far-right media endlessly look for bad events and a way to pin it on migrants. I have seen AfD marketing to tell people they will somehow "fix things" by replacing burkas with burgundy wine.

I've also seen that the neo-Nazis try to overthrow the government (Reuß) and carry out domestic terrorist acts (Hanau for example), the constant planning for "Tage X" and stealing weapons from the army, and the arm of the government charged with constitutional protection constantly needing to stop Nazi activity or investigate problems with the AfD or the military or other important authorities.