maccam912
Joined 12 years ago
Karma
384
Submissions
121
Member since
Aug 22
[ my public key: https://keybase.io/koski; my proof: https://keybase.io/koski/sigs/vi7RKurm6R7ZOGCa8BGj5-y8XYPSzvwr_C2doaVQbHw ]
View on Hacker NewsJoined 12 years ago
And I can't overstate how easy it was. The swarm page thing had a little "join" button and said to run "mesh-llm --auto". And I did. And it worked first try. That is such an uncommon experience I had to report back. It handled picking a model to serve, downloading it from peers, and to test it I chatted with the model I was hosting, I could see the GPU doing work, etc.
It might be more of an endorsement for iroh than mesh-llm, although I'm sure getting it to all work seamlessly took work on both sides. But to whoever spent the time and energy trying to make it seamless, consider the effort recognized!