Beached
Joined 13 years ago
Joined 13 years ago
I believe they have confirmed there will be Qwen4 Max, Plush, Flash, and 27B as the 4 open weights they plan to release. Starting next week, but they didnt specify if they plan to release all 4 at once, or if they plan to just release one of them, and trickle the others out over time. (They likely will do the latter to stay in the news longer)
The best option we have current is likely Qwen 3.8 Flash Next. Which is about equivalent to Opus 4.6
however Qwen4 was announced to be released next week. Which people think will let LocalAI jump to just above Opus4.8
Also of note, there isnt really a harness as good as claude yet either. The harness is also a very important piece to the puzzel, and those also fall behind frontier capability too.
But their harness is so good, and their model is so good. Using them together is just unbeatable at the moment, even with all the restrictions and annoyances they have in place.
Im excited for qwen4 release next week, Im really looking forward to putting qwen4 flash + cline/bot through the paces. I dont expect it to be nearly as good as Opus5.5+Claude but I'm hoping im hopeful it will make an OK-Enough alternative if they get even more dragocian.
At this point, I would like to consider other options, but if I want to get work done, opus 5.5. Hell even sonnet 5.5 is better than anything OpenAI has to offer when it comes to coding.
Many people are expecting it to sit somewhere above Opus 4.8 to opus 5 (not above, but the unquanted version of their largest model is expected to perform around here)
Anyone who cares to keep their current capability should definitely be looking at localAI and using it for at least their more routine tasks , even if it is qwen4 27B quant 4 on their gaming rig.
A pi zero is to play with, an esp32 is so tiny, that it is more of a build for a single thing, and then set it and forget it doing that single thing.
You cant really stack more and more cool stuff onto it and keep building on it.
This happens all the time. Unfortunately, in my experience, most of the risk acceptance happens without even really believing in the cost of the risk, and people just accept everything. it is highly likely someone like that accepted this.
If a PERSON executes software, and that software breaks the law, the PERSON that executed the software should be held responsible. AI is software. It is not a sentient person who can be fined, thrown in jail, or held accountable.
If you use AI to perform a crime, you should be held accountable for that crime. Saying "Oh, AI did it, so no consequences" isnt acceptable. And "I didnt know AI would do it" shouldnt be an excuse either.
You authroied untested and unproven hardware to skate around the internet at random unsupervised and take liberties on its own.
My ass would be thrown in jail if I wrote code that skated around the internet chucking RCE's at random sites. WHy is "AI did it" a get out of jail free card?
I love local models, and I run 3.8 Flash Next on a dedicated machine. Alone with a number of image and video generation models. But if I'm doing REAL work, that isnt tinkering for fun on a side project, im using claude, because Qwen3.8 just cant handle large context project well without going off into left field.
Im SUPER jazzed for qwen4 with 1mil token context native support. I HOPE it a step up from 3.8 flash next. Ill be playing with all the qwen4 models the moment I can, but I dont see how someone working on large code bases doing REAL enterprise grade work is seriously using any local models in any capacity that comes remotely close to Opus 5.5+Claude