pferdone
Joined 10 years ago
Karma
277
Submissions
112
Member since
May 30
Joined 10 years ago
2) Since it's unified memory, you won't have 96GB available.
3) I offered a solution that is usually recommended to the "gpu poor", if he's concerned with how much memory he would need.
4) I stated, that people already pointed out how he should be fine and that "gpu poor" doesn't apply to him.
5) "gpu poor" depends on what model you are trying to use. If you want to run Kimi or GLM you are still "gpu poor" even if you have an RTX Pro 6000 with 96GB of VRAM.