Comment Comment by oa335 > it costs >1000% to run inferencedo you have a source for this claim? i thought LLM providers earn high margins from inference (charged by token). is this no longer the case? parent oa335 4 months ago
do you have a source for this claim? i thought LLM providers earn high margins from inference (charged by token). is this no longer the case?