Is it weird to anyone else that the M5 keeps the same limitations of the M4, and tops out at 128 GB of RAM?
If one wants to serve large-ish LLMs locally, an M3 Mac Studio w/ 512 GB/RAM is still a super compelling option, and I was hoping that the M5's would bump us up to 1TB of unified memory.
Don't get me wrong -- seeing them use LMStudio as the benchmark for measuring local LLM inference is super awesome for the local / open-source LLM community, but seeing this have the same 128GB cap as the M4 is... disappointing?
M3 Studio is still the best option if one wants 512GB.
If one wants to serve large-ish LLMs locally, an M3 Mac Studio w/ 512 GB/RAM is still a super compelling option, and I was hoping that the M5's would bump us up to 1TB of unified memory.
Don't get me wrong -- seeing them use LMStudio as the benchmark for measuring local LLM inference is super awesome for the local / open-source LLM community, but seeing this have the same 128GB cap as the M4 is... disappointing?
M3 Studio is still the best option if one wants 512GB.