Comment

Comment by alanfranz

From: https://support.claude.com/en/articles/16266773-how-claude-m...

> We'll support users and other third parties to detect Claude’s marks

This is the part that I fear most. What happens with false positives? Will I need to change arbitrary parts of my text if they are flagged as AI generated? Will I be forced to add mistakes?

And then, since LLMs are trained on existing, human-written, quality content, it may be that well-written text gets accidentally flagged more often?

And, if all the providers do this, and they use different watermarks, will I be forced to change things at random until I get a negative from all of those?

I very much think this will yield the wrong signal. There were already some academic plagiarism checkers around that would return false positives, and were blindly trusted by teachers and professors. I suppose AI checkers are all around now, and there will be more of those.

Proofreading is one of the best uses of LLMs that I can think about - I still write my text, then an LLM fixes some of my "errors" since I'm not a native speaker. It usually improves clarity. But now I risk my text to be classified as AI written with potentially bad outcomes.

I don't know whether I should blame the EU, though :-)

parent alanfranz 3 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton