We have had this for years. The term is Light Field Camera. There was an attempt several years back to do this with the Lytro camera. It worked but had a few major issues. For one the resolution loss was fairly substantial. There was also a fair few issues around the fact that the only way to share the photos was a cumbersome vendor lock in site iirc.
With more modern sensors you might be able to fix the resolution issue as I recall it being around 2010 or so.
With more modern sensors you might be able to fix the resolution issue as I recall it being around 2010 or so.