Comment

Comment by dist-epoch

Doesn't decode also need to stream in the whole of the model weights, thus very I/O heavy?
parent dist-epoch 1 year ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton