Comment by vinni2

Can you share some of your wisdom on setting up a scalable inference infrastructure?