hogu
Joined 16 years ago
Karma
798
Submissions
312
Member since
May 19
Joined 16 years ago
The article walks through how resources are provisioned, how environments are created, how GPU jobs are scheduled, and what abstractions we use to keep the system flexible while hiding most of the complexity of the underlying cluster. It also includes some of the design decisions we made along the way and a few of the tradeoffs we ran into.
Since we built the system, I’m happy to answer questions about the architecture, decisions, limitations, or areas we are still iterating on.
We get all developers at our company System 76 linux laptops as their primary dev machine (Lemur Pros with 40 GB of ram)