Comment

Comment by ddren

They have recently merged support for x86. I get 230ms/token on the 13B model on a 8 core 9900k under WSL2.
parent ddren 3 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton