Comment Comment by nmca Isn’t the answer to the question just classic economies of scale?You can’t run GPT4 for yourself because the fixed costs are high. But the variable costs are low, so OAI can serve a shit ton.Or equivalently the smallest available unit of “serving a gpt4” is more gpt4 than one person needs.I think all the inference optimisation answers are plain wrong for the actual question asked? parent nmca 1 year ago
You can’t run GPT4 for yourself because the fixed costs are high. But the variable costs are low, so OAI can serve a shit ton.
Or equivalently the smallest available unit of “serving a gpt4” is more gpt4 than one person needs.
I think all the inference optimisation answers are plain wrong for the actual question asked?