Azantys

When models are in the hundreds of gigabyte range, there are not enough nodes to train, because most people dont have 100k in AI hardware. Also there is no training method for machines scattered around the world as far as I know.

Or they suffer from skill atrophy by overreliance on LLMs.

AMD driver support is great due to community effort, even for 10+ year old cards. Nvidia also now has (partly?) open drivers.

The whole point was for the formalization to be clean enough so it could be reused in other parts of mathematics as I understand it. 13M lines of AI slop which have never been checked do not sound like what the original goal for such a formalization was. Also Claude didnt prove anything it just translated an already existing proof by Wiles into Lean, so it didn't actually contribute anything other than "Guys we did this thing, look how great our model is!". We never questioned that a printer can print faster than a human can write, but we dont let printers write novels.

Yes, but you can use local models with opencode/pi

Its 27B not 37B and having just 27B in total and 3T and like 30B active of those is still totally different. A 120B with 5B active is still much slower than a proper 5B. Just like the new Ling 3.0 Tiny with 8B and 1B active only gets around 120tk/s compared to 250tk/s which a real 1B one gets on my hardware.

At one point there were specific -Coder release of Qwen e.g. 2.5 but they dropped that, still wondering how much better 3.6-Coder or 3.8-Coder would be when they ignore everything else

Dysfunctional vibeslop

Here you have shown yourself that progress slows down and doesnt speed up. 8.9/0.35 = ~25x more performance in 10 years from 2006 to 2016. 104.8/8.9 = ~12x more performance in 10 years from 2016 to 2026. Growth has dropped 50%.

You already can with AMD/Intel gpus. Kraid is a compiler for Arm Mali which is mostly used on mobile stuff, nothing AI related.

I questioned the speed not the output quality, that is another discussion

? Readme says 60-70s per token

0.01 tk/s is unusable for anything, you would wait a whole day for just 1000 token of output, what is the point of projects like this?

Free month is insane for a bit of downtime