Flamentono2
Joined 1 year ago
Joined 1 year ago
I would argue that if he wants to do AGI through RL, a LLM could be a perfect teacher or oracle.
After all i'm not walking around as a human and not having guidance. It should/could make RL a lot faster leveraging this.
My logical part / RL part does need the 'database'/fact part and my facts are trying to be as logical as possible but its just not.
Nonetheless, yes we do know certain brain structures like your image net analogy but the way you describe it, sounds a little bit of.
Our virtual cortex is not 'just a layer' its a component i would say and its optimized of detecting things.
Other components act differently with different structures.
You assume too much...
One demo i saw with LLM and code use: "Generate a small snake game" and because the author still had the Blender MCP tool connection, the LLM decided to generate 3D assets through Blender for that game.
completly disagree. People might have googled before but the human<>computer interface was never in any way as accessable as it is now for a normal human being. Can i use Photoshop? yes but i learned it. My sisters played around with Dall-E and are now able to do simiiliar things.
It might feel boring to you that technology accessability drips down like this, but this changes a lot for a lot of people. The entry barrier to everything got a lot lower. It makes a huge difference to you as a human being if you have rich parents and good teachers or not. You had never the chance to just get help like this. Millions of kids struggle because they don't have parents they can ask certain questions required for understanding topics in school.
Steam Engine = fundamental for our scaling economy electricity = fundamental for liberating all of us from day time internet = interconnecting all of us LLM/ML/AI = liberating knowledge through accessability
> 'There hasn’t been a real breakthrough in over two years.' DeepSeek alone was a real breakthrough.
But let me ask an LLM about this:
- Mixture of Experts (MoE) scaling
- Long-context handling
- Multimodal capabilities
- Tool use & agentic reasoning
Funny enough your comment comes before claude 4.0 release (again increase in performance, etc.) and the Google IO.
We don't know if we found all 'low hanging fruits'. The meta paper about thinking in latent space came out in February. I would definitly call this a low hanging fruit.
We are limited, very hard, on infrastructure. Every experiement you want to try consumes a lot of it. If you look at the top x GPU AI clusters, we don't have that many on the planet. We have Google, Microsoft, Azure, Nvidia, Baidu, Tesla and xAI, Cerebras. Not that many researcher are able to just work on this.
Google has now its first Diffusion based Model active. 2025! We are so far away from testing out more and more approaches, architectures etc. And we are optimizing on every front. Cost, speed, precision etc.
I created images and music which was enjoyable. I use it to add more progress to an indie side project I'm playing around with (i added more functionality to it with ai stuff like claude code and now jules.google than i did myself in the last 3 years).
It helps my juniors to become better in their jobs.
Everything related to sound / talking to a computer is now solved. I talked to gemini yesterday and i interruptted it.
Image segmentation became a solved problem and that was really hard before.
I can continue my list of things AI/ML made things possible in the last few years which were impossible before that.
Nonetheless, survival can't be the life goal after all the moon will drift away from earth in the future, the sun will explode and if we survive that as a species, all bonds between elements will disolve.
It also can't be about giving your dna away because your dna has very little to no impact over just a handful of generations.
And no the goal of our society has to be to have as much energy available as possible to us. So much energy, that energy doesn't matter. There is enough ways of generating energy without a real issue at all. Fusion, renewable energy directly from the sun.
There is also no inherant issue right now preventing us all having clean stable energy besides capitalsm. We have the technology, we have the resources, we have the manufacturing capacity.
To finish my comment: Its not about energy, its about entropy. You need energy to create entropy. We don't even consume the energy of the sun, we use it for entropy and dissipate it back to space after.
At least with AI Video you can now always say its AI video.
Is it shitty that this is possible? yes of course. But hidding knowledge never works.
We have to deal with it as adults. We need to educate about it and we need to talk about it.
Im pretty sure kid/child ai porn already exist somewhere. But i'm quite lucky despite knowing rotten.com and plenty of other sides, never having seen real so i doubt i will see fake child porn.
Whats the elephant in the room now? Nothing changed. Whoever consumes real will consume fake too. FBI/CIA will still try to destroy cp rings.
We could even think it might make this situation somehow better because they might consume purely virtual cp?
But what it means, that with time, Opensource will be as good as what commercial offerings now have. Hardware will get cheaper, research is open or delayed open.
Renewable energy is easily able to provide enough energy sustainable. Batteries can be recycled. Solar panels are glas/plastic and silicium.
Nuclear is feasable, fusion will happen in 50 years one way or the other.
Existens is what it is. If it means being able to watch cat videos, so be it. We are not watching them for nothing, we watch them for happiness.
Just because some people on reddit 'laugh' at these discussions, in one of the PRs a contributor/maintainer actually said that they enabled it on purpose, are not forced and are happy to test it out.
And someone somewhere has and want to test stuff. Whats the issue? Test it out, play around with it, keep it or disable it.
And i think .net as a repository is a very good example. The people on github copilot side are probably very happy about this experiement. For me its also great, it seems like github copilot is still struggling a bit.
And copilot is called copilot because they do not advertice it as replacement.
I said move money from A to B, which implies that nothing else is happening. Otherwise it would be an exchange.
Sooo i would say my wording was right?! :)
Hey look you see a stone falling