>I feel a quality prompt engineer could beat 85% with GPT4.
I generally don't pull the "you're not prompting it good enough" card unless i have direct experience with the task but this does raise a few flags - "between 42 and 86% of the time, depending on how the researchers presented the task."
I would have liked them to show how they presented this task, at least something more than a single throw away line, given how integral it is to the main claim.
I generally don't pull the "you're not prompting it good enough" card unless i have direct experience with the task but this does raise a few flags - "between 42 and 86% of the time, depending on how the researchers presented the task."
I would have liked them to show how they presented this task, at least something more than a single throw away line, given how integral it is to the main claim.