Comment by boroboro4

For production loads? No one will run DS without expert parallelism so it’s not important for model to fit on one gpu.