Comment Comment by mikeayles I just posted a Show HN of my most recent side project, a live demo of a tiny-llm implemented in FPGA fabric, hitting an aggregate peak of 60,000tok/s, but a 'usable' model at 21,000tok/sWriteup and demo here: https://www.mikeayles.com/blog/on-chip-llm-kv260/Source and HDL here: https://github.com/MichaelAyles/kev-gptShow HN here: https://news.ycombinator.com/item?id=49242475 parent mikeayles 2 months ago
Writeup and demo here: https://www.mikeayles.com/blog/on-chip-llm-kv260/
Source and HDL here: https://github.com/MichaelAyles/kev-gpt
Show HN here: https://news.ycombinator.com/item?id=49242475