It’s a good question; it’s not something that worries us too much to be honest.
The linear patchificaion is per patch, so if it works on 360p 2 seconds (really short low res) it should adapt naturally (given ROPE3D). The final layers of the DiT start moving us from latent space to pixel space.
Net net the compression is as much as H3 (32x32xTime) so it should be comparable to the best VAEs in terms of expense
The linear patchificaion is per patch, so if it works on 360p 2 seconds (really short low res) it should adapt naturally (given ROPE3D). The final layers of the DiT start moving us from latent space to pixel space.
Net net the compression is as much as H3 (32x32xTime) so it should be comparable to the best VAEs in terms of expense