abatilo
Joined 9 years ago
Joined 9 years ago
I'll sometimes chat with the people who have had to maintain whatever ground work I had laid, and each time around, I get a little bit better at laying down a framework of infrastructure and operations that's better and better at staying sustainable
It's been years that writing Dockerfiles has been fairly common. Years. And yet it's still so common that people write such poorly optimized Dockerfiles.
I think we should definitely start thinking about admitting that it's too much over head for people to learn how to write a Dockerfile.
That being said, I've known Kyle for a while now. The team at Depot have consistently shown the deepest possible understanding of the container ecosystem. I'm very excited to see what else they do.
I'm not officially affiliated with them at all. But I'm a big fan of their product.
It appears that one difference though is that Depot is more focused on just docker builds and y'all are more generalized runners Is that right?
In other words, they're used when you want to share some kind of state across all of the computers, without the potential overhead of communicating to some other system like a database.
Physics simulations and like, molecular modeling come to mind as common examples.
In the case of ML training, model parameters and broadcasting the deltas that get calculated during training are that shared state.
As of 2 months ago, they had at least 7000 up and running, fwiw
https://aaronbatilo.dev