Comment by aditya_rs

Yep, that's what I think and wrote on my blog. My hope is that the inference providers should provide a managed service like it. It's also in their best interest to do so, because if they don't and these provider hosted agents become the norm, demand for independent inference would drop.