I suspect that Dots and Duet are very high margin drivers for the labs. Personal assistant chat sessions don’t have to be realtime, so workloads can be scheduled on low priority batches and be waited if higher value work comes into a queue.
Inference providers are always trying to fill inference batches and having a stream of low priority requests can help pack batches that might have gone empty, without raising the latency of higher priority requests such as live chat sessions.
While Dot and Duet certainly need to be useful to work out as products, I think the gross margin mechanics are just as interesting.
Inference providers are always trying to fill inference batches and having a stream of low priority requests can help pack batches that might have gone empty, without raising the latency of higher priority requests such as live chat sessions.
While Dot and Duet certainly need to be useful to work out as products, I think the gross margin mechanics are just as interesting.