Comment Comment by bigyabai Apple's biggest bottleneck for real-world inference is prefill processing. They need a better GPGPU architecture, which is what I'm expecting M7 to reveal. parent bigyabai 2 months ago