Comment by lowsenberg

I'm hoping that hosting providers such as Hetzner will soon offer inference at reasonable prices and hosted in the EU with this kind of framework.