I am not sure who is the intended customer for this service.
The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero.
Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilisation.
Btw landing page does not bring much confidence this is serious. Might want to change it to communicate better and also to be attractive to "developers" I guess.
The prompt and the model go hand in hand. If you randomly select the model the likelihood of getting something consistent is basically zero.
Also model pricing don't very that much. I have never heard of spot-instance equivalent for inference although that will be cool. The demand for GPU is so high right now that I think most datacenters are at 100% utilisation.
Btw landing page does not bring much confidence this is serious. Might want to change it to communicate better and also to be attractive to "developers" I guess.