But is it stable? I've seen a video on YouTube [0] where someone was showing LLM inferencing on a MacBook compared to an NVIDIA card, and it was really good, but before the video was over, everything on the Mac stopped working (he was also recording via OBS I think and it went to a halt).
This was a MacBook, but since you're just saying "Mac", I don't know what you're referring to.
I think that the MacBook couldn't cope with the heat generated so it went to its knees. I've read about it on Reddit as well.
This was a MacBook, but since you're just saying "Mac", I don't know what you're referring to.
I think that the MacBook couldn't cope with the heat generated so it went to its knees. I've read about it on Reddit as well.
[0] https://youtu.be/jaM02mb6JFM?t=411