Comment by scheme271

My point was really about profitability in general. The inference portion might be profitable but if training and operating costs are very large, then that can make the whole thing unprofitable. E.g. if it costs you $100B to train a good model but you make $0.00001 per inference token, you may not be able to hit breakeven for a very long time.