hashmap

kind of boggles me that the big ai labs arent running zero-shot classification on all their outputs with "does this look like any of these bad things we know people get up to"

"Look, it wouldn't have even mattered if we had done advanced cyber security like turn off internet or look at logs when huggingface was attacked!! See look it can still.. *prompts a shitload of agents, waits 6 hours* look wowwww they still learned how to talk to each other even if we turned internet off!"

"They wouldn't have been able to attack huggingface though, thats still criminal negligence."

"No see this actually means airgapping doesn't even matter theres nothing we can doooooo!"

"...ok, turn them off and delete them I guess"

"Well no of course not everyone else is doing it so like. No courts please just like be in awe"

for putting together something like a tool-call decision model, the conditioning will take less time than getting the data for it, which also will not take much time if you keep your session data. whatever fails is your negative contrast, whatever passes is your positive data. the space of tool calls your agents will use in your particular environment is not actually that big, which makes this one of the easiest wins you can pull off.

there is a lot more of me getting to choose what it is i end up doing each day. i find fun in doing those things now pretty regularly. cracking a tough problem can feel as good as jumping out of a plane did. that is to say, my brain is still not a great judge of how relatively cool something is, because even something like scuba diving or fast sports were wildly cool the first time and then the second time it was like "this again?".

i feel much safer though knowing that now when i sometimes get a little bit of the itch, i'll think about it for a few seconds and go "eh, maybe later," and return to trying to make a thing, or play some music, or why is that stupid thing still broken oh its because i broke it.

That is the opposite of dumb, you can use the next token likelihood to macgyver together a jev in a pinch exactly that way, you just would also want to take some steps to scramble up the choices to smooth over bias and tokenization artifacts. llms have favorite letters for example. Qwen likes A and D.

I saw those moving dots and snap-closed the page.

How did you manage describe a litany of automation while being fully unaware that is what you were doing? I mean you even said the word autopilot lmao. Yes, not all tasks in a job are fully automatable. iPhones, automating communication. Quickbooks and turbotax, automating business workflow steps.

The words and excels of the world, automating documentation and bookkeepery. It all makes some kind of existing thing we already do faster and more convenient, and often more efficient. Most software simply does nothing new. The thing you didnt manage to list which is the actually good example is games.

As a software engineer? The career whose very reason, largely, for existing in this market is to automate jobs, with few notable exceptions? That one is somehow deserving of sympathy and that of mathematicians is not? Come off it. The notion is undignified.

Put someone in charge who made their way by underpaying people to sit and label data vs the inventor of convolutional neural networks. Its no coincidence that shortly after his tenure ended, a model that took a long time to prepare started becoming actually useful.

Comments like this one reinforce the obvious truth that the people who are most "pro ai" are the ones who understand it the least

rlhf will cause models during training to hide data in regions not typically accessible to them in the geometry during inference, due to competing objectives, so i wonder if this looks like that.

So far, he is right. No frontier model right now performs well on making intuitive physics decisions when working on novel VR physics interactions. They literally all fall on their faces and it is very frustrating.

You're missing the point here. He's not talking about whether or not they can learn facts or inferences derived from the text itself, but the more holistic intuition that results from learning from something like an embodied experience in the physical world. GPT-6 Astras web demo homepage thing is an example. It chose euclidean rather than quaternion for letting a user rotate the galaxy thing, and anyone who has ever used hands to rotate something would immediately recognize on trying it that something is fucked and you shouldnt do that. Thats the kind of common sense physics that is inherently beyond these llms and I run into it ALL the time in vr programming.

how long until cutting out the token middleman and just keep the cache constant sized but edit it and just send the model new information instead of the same thing over and over. token bad latent good.

Are you arguing that training on copyrighted material is fine but distilling against tos is somehow bad? Lmao what a take. Nah, if copyright cant even be enforced then theres no way on earth violating a tos should ever have repercussions other than they ban you. stop carrying water theyre not gonna pay you