Comment Comment by gbxk Amazing project, I love it.How about using these Cactus models?Would it make sense for you to collab with those guys (1) for you to design a cheap but improved, commercialisable version of your $250 chip and (2) for them to tailor their runtime and quantizations to such FPGA hardware?https://github.com/cactus-compute/cactusAlso have you thought about using a Alveo V80? Still not crazy expensive and could fit bigger models with same approach parent gbxk 2 months ago
How about using these Cactus models?
Would it make sense for you to collab with those guys (1) for you to design a cheap but improved, commercialisable version of your $250 chip and (2) for them to tailor their runtime and quantizations to such FPGA hardware?
https://github.com/cactus-compute/cactus
Also have you thought about using a Alveo V80? Still not crazy expensive and could fit bigger models with same approach