This is great and looks very easy to use! I'd expect it to have a huge impact given how easy it makes for people to leverage a few or a few thousand GPUs. I do have a few questions, of course.
Is it getting a lot of internal use already (beyond the example we just heard about)?
Is it possible to do inference using a CPU and a lot of RAM using a model trained on multiple GPUs via DeepSpeed?
Does it work with TPUs right out of the box? It looks like maybe not - if not, any plans to support them?
Can you use DeepSpeed to train using a lot of CPUs + ram rather than GPUs?
Is it getting a lot of internal use already (beyond the example we just heard about)?
Is it possible to do inference using a CPU and a lot of RAM using a model trained on multiple GPUs via DeepSpeed?
Does it work with TPUs right out of the box? It looks like maybe not - if not, any plans to support them?
Can you use DeepSpeed to train using a lot of CPUs + ram rather than GPUs?