Comment by tzahifadida

LLMs have trouble with open labeling tasks, this was studied. But, what also was studied is that if you instruct it how to score something, it can do it not so far than a human. If you leave out the instructions, I believe it can be considered an open codebook and therefor it probably wont work well.