Comment Comment by neko_ranger Four H100 in a 2U rack didn't sound impressive, but that is accurate:>A typical 1U or 2U server can accommodate 2-4 H100 PCIe GPUs, depending on the chassis design.>In a 42U rack with 20x 2U servers (allowing space for switches and PDU), you could fit approximately 40-80 H100 PCIe GPUs. parent neko_ranger 1 year ago
>A typical 1U or 2U server can accommodate 2-4 H100 PCIe GPUs, depending on the chassis design.
>In a 42U rack with 20x 2U servers (allowing space for switches and PDU), you could fit approximately 40-80 H100 PCIe GPUs.