Comment by zamalek

What's the deal with memory? Does it use the system RAM? I've been considering a cluster for local inference.