Comment Comment by austinvhuang Some may also find Junji Hashimoto's GPU programming library in lean (w/ webgpu) interesting:https://github.com/Verilean/hesperEven includes an example of transformer inference (quantized 1.5 bit):https://github.com/Verilean/hesper/blob/a688ce9848d6416b2e95... parent austinvhuang 8 months ago
https://github.com/Verilean/hesper
Even includes an example of transformer inference (quantized 1.5 bit):
https://github.com/Verilean/hesper/blob/a688ce9848d6416b2e95...