Comment Comment by bigyabai > only 48 GB of memory.You can layer the LLMs across multiple GPUs, you can absolutely have 192gb of Nvidia dGPU memory with the right MOBO and CPU combo. parent bigyabai 3 months ago
You can layer the LLMs across multiple GPUs, you can absolutely have 192gb of Nvidia dGPU memory with the right MOBO and CPU combo.