Comment Comment by cbeach My 5090 has a bandwidth of 1,792 GB/s, and that is just about good enough for basic (i.e. 27B models) local LLM inference.The fastest M6 MacBook Pro (24/32GB configs) has a memory bandwidth of 170 GB/s. And the M5 Max is 614 GB/s.Am I missing some nuance of the M6 MBP here, or am I right to assume it won't set the local LLM world on fire? parent cbeach 4 days ago
The fastest M6 MacBook Pro (24/32GB configs) has a memory bandwidth of 170 GB/s. And the M5 Max is 614 GB/s.
Am I missing some nuance of the M6 MBP here, or am I right to assume it won't set the local LLM world on fire?