crorella

The key is to use llms to create CNN models

oops! This is totally unexpected coming from Meta.

Haha, I was thinking the same, I think we will see the most random devices being able to host models in the near future. An army for the techno core.

Should be both the entity providing the platform where the inference is running + the entity giving the prompts/instructions.

It looks like a lot like how data bases query optimizers work, with the exception that in the paper there is also a learning/memory component that conditions the evaluation of the answer provided by the first model.

What are good options to run local models nowadays? Something good for coding and personal assistant kind of things

This sound very interesting, do you have any resource I could look at? Me and my son did a very rudimentary (compared to yours) setup to play Paranoia, but this is at another level.

it has been for ~2 years already, it is like voice mode and you can talk for up to 30 mins with it IIRC

Fun/interesting to see how opensource models surpassed Anthropic's

I had the same visceral reaction lol, so ugly.

Tokenmaxxing makes no sense, it is akin to write extremely inefficient SQL / Spark Jobs, full of cartesian joins, ultra skewed datasets, etc, just for the sake of using as much compute / memory / IO as possible.

This always happens when the metric becomes the goal, companies should nurture and foster an environment where AI is used in the most efficient way possible, first asking "do we really need an agent for this" and if so, what kind of agent is needed, what model, reasoning level, etc.

They should also promote projects that aim at saving tokens, increasing cache hits, codifying the information in ways such they use as less context as possible (graphs of knowledge are pretty good for this!)

what a weird surface to put LLMs

Same! At first I was wary of using it because the UI looked less polished, but from the start the stability has been vastly superior and now the UI is much better too.

as a bonus, I have a old version Emby Theather (the windows form based one) that plays 4K with no issues on my computer unlike browsers that fail at that.