Comment Comment by Tepix $50K seems low if you want to run, say, GLM 5.2 4bit fast enough for a team for devs.You need something like 6x RTX Pro 6000 at $11800 each plus a nice server (add $10000) = $80800 and then quite a bit of electricity. parent Tepix 4 months ago
You need something like 6x RTX Pro 6000 at $11800 each plus a nice server (add $10000) = $80800 and then quite a bit of electricity.