Comment by laingc

What's the current state-of-the-art in deploying large, "self-hosted" models to scalable infrastructure? (e.g. AWS or k8s)

Example use case would be to support a web application with, say, 100k DAU.