I run a lot of local models (I am always experimenting) on my 32G M2-Pro MacMini - I would love to upgrade.
The financial aspects don’t work however: I can learn and experiment with what I have for local models, and I pay as I go on FireWorks.ai for open model inferencing and no matter how much I use this service my monthly bill is between $10 and $40 and much faster than any reasonable home rig.
Hybrid ‘small local’ and buying inference is the way I choose.
The financial aspects don’t work however: I can learn and experiment with what I have for local models, and I pay as I go on FireWorks.ai for open model inferencing and no matter how much I use this service my monthly bill is between $10 and $40 and much faster than any reasonable home rig.
Hybrid ‘small local’ and buying inference is the way I choose.