Comment by winterbourne

I was just thinking about the good old days combining human judgements on mturk for classifying high-value forum threads. Since replaced by using judgements from multiple LLMs.

The only use I can think of it these days is for social scientists who need to gather judgements from bona fide humans.

This will be devastating for a lot of workers in low-infrastructure countries.