What about the cost? Inference looks like a viable business model for those operators that have access to SOTA model and serving infrastructure, but the investment required to have it is enormous, and appears to be never-ending, because if an operator stops investing aggressively, its model and serving infrastructure quickly become non-competitive, and customers will quickly leave for alternatives.
What about the cost? Inference looks like a viable business model for those operators that have access to SOTA model and serving infrastructure, but the investment required to have it is enormous, and appears to be never-ending, because if an operator stops investing aggressively, its model and serving infrastructure quickly become non-competitive, and customers will quickly leave for alternatives.