Comment

Comment by mikeayles

I haven't written a new blog post for it yet but there's currently a demo live of my FPGA running bonsai 8b on the same FPGA here

https://www.mikeayles.com/blog/on-chip-llm-kv260/

Its right up against the wall of DDR bandwidth, so I'm trying every trick in the book to get the speed up

parent mikeayles 9 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton