Comment by singhrac

It’s prompt processing so prefill - that’s compute bound not memory.