potus_kushner

dude talks about measuring C while the code he shows is C++.

at first this looked like something one could run on CPU with 64GB RAM with a 2-3 bit quant, at possibly half the speed of 3.6 35B-A3B, however the 50B ngram sidecar makes it impossible. and oddly, unsloth's page lists the ngrams as 50GB even though they say it's in 4 bits. should be 25GB according to my math. anyway, the new ngram architecture makes it pretty much unusable for regular folks who cant afford more than 32-64 GB ram in this RAMocalypse.

the xhigh version looks amazingly good for a 2 bit quant.

another strong Qwen 3.6 35B-A3B fork with open weights.

impressive work. but a GGUF release + (ik_)llama.cpp PR would be appreciated since not everybody has a mac.

pretty impressive model for its size, if the benchmarks can be trusted.

hopefully for us mere mortals without $4k+ hardware a 35B MOE model will be released. or a new prism ternary bonsai model based on this one.

the ramblings of a madman.

memcpy and friends have been living peacefully in string.h since 1989, but alejandro colomar wants to move them to memory.h.

since he's overtaken the maintainance of the linux manpages project, his unilateral moves to change libc interfaces according to his personal preferences have been confusing and infuriating. his work is to document existing interfaces, but instead he abuses his position to override existing specifications, in what appears to be acts of sabotage.