Comment by neilellis

Also FYI doesn't run inference on Apple GPU (only for training)