Comment

Comment by version_five

Where does the performance difference come from? And in what kind of processor & gpu? I didn't even know llama.cpp had a 32 bit option. For now I'm pretty suspicious it's a fair comparison.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton