diminish
Joined 16 years ago
Joined 16 years ago
the real challenge will be in the frontier of the human knowledge and whether llms will be able to advance things forward or not.
ps1; i'm using 5.3/o4.6/k2.5/m2.5/glm5 and others daily for development - so my work has 1.5x intensified - i tackle increasingly harder problems but llms still really fail big in brand new challenges like i fail too. so i'm more alert than ever.
ps2: syntactical autocomplete used to write 80% of my code; now llms replaced autocomplete but at a semanticlevel; i think and LLM implements most of my actions like a cerebellum for muscle coordination; but sometimes teaching me new info from the net.
> right tools allow small models to perform better than undirected tool like bash to do everything.
Interesting enough the newer mini swe agent was refutation of this hypothesis for very large LLMs from the original swe agent paper (https://arxiv.org/pdf/2405.15793) assuming that specialized tools work better.
Single thread performance of 16-core AMD Ryzen 9 9950X is only 1.8x of my poor and old laptop's 4-core i5 performance. https://www.cpubenchmark.net/compare/6211vs3830vs3947/AMD-Ry...
I'm waiting for >1024 core ARM desktops, with >1TB of unified gpu memory to be able to run some large LLMs with
Ping me when some builds this :)
Lack of tools in mini-swe-agent is a feature. You can run it with any LLM no matter how big or small.
We need a new browser fork! Linux way of governance could be awesome; a star leader/programmer- with community and enterprise contributors.
/just switched to librewolf for the short term; after years on firefox since early 0.x days
I see that model type "gpt_refact" in https://huggingface.co/smallcloudai/Refact-1_6B-fim/blob/mai...
So I doubt humans with AI will replace humans without.
I've reported dozens, yet they never finish coming at me.