I don't have much faith that the stated goal is realizable, I don't think fMRI data holds enough information for faithful reconstruction. What it will end up being, like all projects like it before, is a massive network that contains:
- An implicit multi-class classifier that returns 1 out of n previously seen images
- Gigantic model on top to hallucinate a reconstruction close to that previous image
In previous projects of this type the reconstruction was blurry because it was essentially the mean of the previously seen images close to the label predicted by the implicit classifier, in this project I imagine they will be photo-realistic since it's a stability.ai project but no closer to the content the subject is thinking about.
I don't have much faith that the stated goal is realizable, I don't think fMRI data holds enough information for faithful reconstruction. What it will end up being, like all projects like it before, is a massive network that contains:
- An implicit multi-class classifier that returns 1 out of n previously seen images
- Gigantic model on top to hallucinate a reconstruction close to that previous image
In previous projects of this type the reconstruction was blurry because it was essentially the mean of the previously seen images close to the label predicted by the implicit classifier, in this project I imagine they will be photo-realistic since it's a stability.ai project but no closer to the content the subject is thinking about.