nmca
Joined 10 years ago
Karma
1,672
Submissions
578
Member since
Nov 24
research engineer
View on Hacker NewsJoined 10 years ago
https://www.tripadvisor.com/Restaurant_Review-g60763-d477541...
You can’t run GPT4 for yourself because the fixed costs are high. But the variable costs are low, so OAI can serve a shit ton.
Or equivalently the smallest available unit of “serving a gpt4” is more gpt4 than one person needs.
I think all the inference optimisation answers are plain wrong for the actual question asked?