Eggpants

I don’t understand what “floating-point math is non-associative” has to do with the random selection of possible result token set after the soft max operation. The weights of the model are set and don’t change during the many matrix operations(which is deterministic regardless of the floating point encoding scheme).

Honest question about the non-deterministic nature of llms. Every programming language provides some way to control the random seed. Is this not true in GPU programming land?

I was stationed on the Lincoln during the first gulf war. Most folks have 12 hour shifts, you wake up in a triple stacked “coffin” bunk(I couldn’t roll over without my shoulders hitting the top of the bunk) and wait in line to shower, then wait in line for each meal all while performing your responsibilities. Plus repeated fire drills in full gear because if a fire isn’t put out folks die. I certainly remember losing all the scheduled liberty ports due to the war. It definitely builds up your stress levels over time to breaking point levels. I didn’t see anyone attempting to jump overboard but did see some purposely hurt themselves.

The only port large enough for a carrier (at the time) was/is Dubai but that just makes the ship a sitting duck right now. I can’t imagine going that long without a break.

Of course it’s never mentioned that all these hacking techniques are in the training set…

Talk about a giant whiff.

I was hoping they would announce their first open weights model, perhaps an older model they don’t offer anymore, but no. Instead he get this bs statement that reeks of “dam it I’m so close to being a billionaire” desperation. Not even acknowledgement of how much data they stole from others yet he whines about distilling.

It’s like his goal in life is to be a Scooby-Doo villain.

And yet two orders of magnitude from making a profit…

I've been pretty happy with LLM svg based data plots I've asked, including log scaled axises and histograms. Definitely a first world problem of course.

The construction of data centers brings jobs, most of the running of data centers is done remotely. There are more security guards than on site tech workers. Just look at the size of the parking lots. In Ashburn Va, a single tech will be assigned to multiple data centers further reducing the number of “decent jobs”.

Then it would be fair game to have an AI answer the hiring AI questions. After all, they now require the use of AI on the job right?

“annualized revenue run rate” is a bogus accounting term. It’s like taking a paycheck and multiplying it by 365. Notice the complete lack of any mention of profits.

I asked it to write a python program to find the intersection of a line and a circle and it one shot it. Asking for a Swift version worked as well. Rust version goofed with lines of comments and code intertwined.

I asked what highway connects two given cities that it got wrong but would have been correct if I asked for two other cities.

I asked it to save answers to a file or notes but no burrito

Asked for an ascii drawing of a race car. Not sure what that thing was it returned.

I’m old enough to remember when one checked the assembly a compiler generated because early on they produced terrible assembly. Eventually they got good enough to not needing to check.

Coding agents are not close to that yet, but it’s interesting watching history repeat itself.

This narrative of the coding agents being so much better now over the last few months seems VERY exaggerated. I’m still spending a lot of time telling Claude: No, that didn’t fix the problem. Again. Can you handle this task or do I have to give it to codex?

What I found interesting is nanoclaw isn’t a working product out of the box. You must use a coding agent to complete it with features you want. For example add iMessage support, etc.

In other words, Claude is the compiler.