Comment Comment by roblabla Well yes, but not so large that it's completely prohibitive. People have been running the full models on computers going as low as $6000: https://x.com/carrigmat/status/1884244369907278106Of course this is for a personal instance, you'd need a much more expensive setup to handle concurrent users. And that's to run it, not train it. parent roblabla 1 year ago
Of course this is for a personal instance, you'd need a much more expensive setup to handle concurrent users. And that's to run it, not train it.