Comment by criemen

And on the topic of prefill: Do you know what the role of GPUs is vs. in inference?