maalber
Joined 2 years ago
Joined 2 years ago
I might get back to you regarding the domain
If you are into visual GenAI you have probably already seen many examples of quite incredible outputs from the new model. However, we decided that we wanted to make a large scale evaluation, based on 200k human responses across 13k image pairings.
Unfortunately that also meant that we had to generate a large amount of new images, and since OpenAI have not yet opened up API access, we had to do it manually through the UI :(.
The benchmark tests the model in coherence, prompt-alignment, and overall aesthetic preference. Especially for the first two, OpenAI's new model is very far ahead of the competition.
Check out the detailed results and the collected data which is openly available on huggingface!
Let me know if you have questions or feedback!
Looks like currently you only support jobs in the US, is that correct?
Nice job on finishing this project though!
Did not really manage to get very far yet, but maybe I will revisit later. I was very confused by frequently going to that landing page, which is still WIP, but I guess it will make more sense to me if I spend some more time. In general I was missing a bit of intro, but I assume that is part of the experience
Is there a reason you did not submit the thread with the link? I was a little bit confused that the title did not take me to the link and I think most HN users would expect that as well - just a pointer :)