jsw97
Joined 13 years ago
Joined 13 years ago
But this is even worse, because there is no way that OpenAI "trained" on this data between September 8, 2026, the date Chenglong Ma uploaded the paper to ChatGPT; and October 6, 2026, the date that OpenAI released a paper with "identical proof strategy and specific choices of notation" (Ma). That's one month, that's not the timescale for model training.
So this implies _not_ that OpenAI is training on user input, in the conventional sense of adjusting weights; but rather that they are *straight-up channeling ideas from user input*, and with a very short lag. You would think there would be about a million controls to prevent this.
This is next-level alarming. I would be very interested in knowing whether Chenlong activated the privacy (do not train, etc) options in ChatGPT, and any other details of their setup (which plan, etc). Also, note that "do not train" might be, in a lawyerly sense, considered by OpenAI to be strictly about weights, and not covering "we hoover up your results and regurgitate them".
My initial thought would be not so much to see whether they converge, but which ones seem to have the most similarity to each other, particularly along the lines of tasks we know are deliberate training goals.
But your point about competence cuts against my goal because it suggests that competent models would simply cluster on the right or efficient solution, which is of course true. So in a sense you want some task where competence is held constant or off the table in some way, which is what you are saying.
I hope somebody does this. I think there's valuable fingerprinting to be done that might suggest who is distilling whom, or at least who is training from common corpuses.
Yes, it's a profitable business for HFT. I'm not too bothered by that.
If you want to direct your ire somewhere, direct it at companies like Robinhood that are gamifying financial markets.