Comment by AndrewKemendo

Off the top of my head:

1. Field of view is limited to existing optics miniaturization

2. Subtractive shading (rendering black) might not be solvable

3. Variable focus objects in the same scene requires projecting n>2 significantly different wavefronts - not solved how to do this with a single vibrating element