ruler88
Joined 13 years ago
Joined 13 years ago
For all of the other commenters - this project isn't about practicality today. Obviously this isn't gonna be as good as using a cloud provider. But the tool draws a line of what is possible. Combination of making the models more efficient, and making local machines more capable can one day get us to a world where very high quality local models are economically feasible.
Remember the early days of Windows? yea it's gonna happen again with AI.
If you are working in a small project with just a few engs. The additional lift for GraphQL might not be worth it. Especially if the team is not already well versed.
With raising minimal wage in the US. We are likely looking at $10/hr in various markets. These robots run 24/7 so that is 1024365 = $87k saved per year. Even with depreciation counted in, it sounds pretty economical to me.