Comment by scrawl

hard to say but it would last some time. china currently is fast-follow mostly via distillation. they don't have the compute resources to catch up. even if their models are more efficient it's hard to beat the folks throwing an unprecedented number of gpus at their models.