> A lot of SaaS AI products fall into that category. ... They’re running dozens of models with unpredictable demand.
How do you know this? What are the numbers like?
> Lambda exists because not every workload is steady state
Vertex AI has all these models via API or hosting the same way. Same features already available with my current cloud provider. (traffic scaling, fine-tunes,all of the frontier and leading oss models)
How do you know this? What are the numbers like?
> Lambda exists because not every workload is steady state
Vertex AI has all these models via API or hosting the same way. Same features already available with my current cloud provider. (traffic scaling, fine-tunes,all of the frontier and leading oss models)