Is it training a model based on 3d model? Is it doing img2img? is doing video2video using 3d video/image as source?
Article is showing off stuff but is light on explanation of what is going on here.
Also, the person is bearded. Hard to notice face changes there. I want to see more demos but instead of a 3d like render, do a realistic render without beard etc.
edit: Plus these are very short clips. 3D should theoretically help, but this article could have been better.
edit2: in the anime example, the girls face is definitely changing (+lips are not correct). It feels like you are doing img2video here?
Is it training a model based on 3d model? Is it doing img2img? is doing video2video using 3d video/image as source?
Article is showing off stuff but is light on explanation of what is going on here.
Also, the person is bearded. Hard to notice face changes there. I want to see more demos but instead of a 3d like render, do a realistic render without beard etc.
edit: Plus these are very short clips. 3D should theoretically help, but this article could have been better.
edit2: in the anime example, the girls face is definitely changing (+lips are not correct). It feels like you are doing img2video here?