Comment Comment by mikeayles I haven't written a new blog post for it yet but there's currently a demo live of my FPGA running bonsai 8b on the same FPGA herehttps://www.mikeayles.com/blog/on-chip-llm-kv260/Its right up against the wall of DDR bandwidth, so I'm trying every trick in the book to get the speed up parent mikeayles 9 days ago
https://www.mikeayles.com/blog/on-chip-llm-kv260/
Its right up against the wall of DDR bandwidth, so I'm trying every trick in the book to get the speed up