Comment by vjerancrnjak

What are hardware requirements to run this?

I see the mixture model is ~ 300 GB and was trained on 256 GPUs.

I assume distilled versions can easily be run on one GPU.