Comment by voiceeh

Not if your use case needs speed. For one of my products I can't use an LLM that has a p99 of >700ms for TTFT.