Comment

Comment by frontsideair

According to the benchmarks, this one is improved in every one of them compared to the previous version, some better than 30B-A3B. Definitely worth a try, it’ll easily fit into memory and token generation speed will be pleasantly fast.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton