Comment by Swinx43

Exactly this. For some reason this is constantly being overlooked/confused. It is very possible to deploy these models inside your own VPC on the big cloud providers and have it be completely secure. I would argue that is even more secure than trusting a model provider’s native API as your traffic is not staying inside your own controlled cloud environment.