Comment

Comment by pferdone

1) It would still run on the Mac's GPU.

2) Since it's unified memory, you won't have 96GB available.

3) I offered a solution that is usually recommended to the "gpu poor", if he's concerned with how much memory he would need.

4) I stated, that people already pointed out how he should be fine and that "gpu poor" doesn't apply to him.

5) "gpu poor" depends on what model you are trying to use. If you want to run Kimi or GLM you are still "gpu poor" even if you have an RTX Pro 6000 with 96GB of VRAM.

parent pferdone 2 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton