beAroundHere
Joined 1 year ago
Joined 1 year ago
Especially that Qwen3.5-35B-A3 looks great for cheaper GPUs. Since a quant version of it would need a <32 GB RAM.
I had written this post to have a higher level understanding of traditional vs Taalas's inference. So it does abstracts lots of things.
I didn't explore the actual manufacturing process.
Infact, I was thinking, if robots of future could have such slots, where they can use different models, depending on the task they're given. Like a Hardware MoE.
I am still waiting if they'd launch GLM-5 Air series,which would run on consumer hardware.
My linkblog is a collection of interesting ideas and snippets I've found around the web. It is tech and non-tech both.
I related with that analogy too, infact that whole piece is worth reading. I can't seem to find it's link though!
Lately, I've used it on Android, and UI which is more suited for e-ink screens, look not so polished on phones, but that's just nitpicking. It's fully usable and keeps adding support for new platforms.
Homepage: anuragk.com
Reach me at: kanurag 0 7 8 'at' the most popular google mail site.