Comment

Comment by crazygringo

Got it, thank you.

So the results are meaningful in terms of establishing that LLM therapeutic performance can be evaluated.

But not meaningful in terms of comparing LLMs with human clinicians.

So in that case, how can you justify the title you used for submission, "New benchmark shows top LLMs struggle in real mental health care"?

How are they struggling? Struggling relative to what? For all your work shows, couldn't they be outperforming the average human? Or even if they're below that, couldn't they still have a large net positive effect with few negative outcomes?

I don't understand where the negative framing of your title is coming from.

parent crazygringo 10 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton