Comment by dexter89_kp3

Self-driving car companies are already working on this. Check out: https://waymo.com/research/block-nerf/

NERF is a very active research area, and the progress from 2020 to now has been nothing sort of astonishing. In 5 years, I expect there to be fully generative NERF's in research i.e describe a scene, and a NN produces a full 3d scene that can you interact with.