Calling the nearest neighbors of the CLIP embeddings of an image "attribution" feels really misleading, the model has been influenced by the entire dataset it was trained on, just by finding the most semantically similar images does not mean the AI is just using that speficific group of images as references, they probably have almost no influence compared to the entire size of the dataset.
P.S. I'm having fun uploading actual photos and art just to see what the site tell me with confidence "These human-made source images were used by AI to generate this image".
Edit: https://rom1504.github.io/clip-retrieval, this site has always been there to explore the LAION dataset using CLIP image/text embeddings and without the need to mislead the user.
P.S. I'm having fun uploading actual photos and art just to see what the site tell me with confidence "These human-made source images were used by AI to generate this image".
Edit: https://rom1504.github.io/clip-retrieval, this site has always been there to explore the LAION dataset using CLIP image/text embeddings and without the need to mislead the user.
Edit 2: As it's showed in this tweet: https://twitter.com/kurumuz/status/1622379532958285824, they are just using CLIP-L/14 and find the most semantically similar images.