Comment by d-ramdass

We (the Modelplane OSS maintainer team) wrote an open guide on inference engineering based on our experience running open-source frontier models at scale with references to some of the best reading materials shared in the industry. Check it out, ask questions, discuss and contribute!