You think it's irresponsible to anthropomorphize software which iterated through versions of itself until it was best able to model and extrapolate the largest trove of anthropomorphic training data to date?
I never really get this perspective. People don't lose their minds when we look at a transformer like Sora modeling fluid dynamics for ships battling in a coffee cup and say "it's irresponsible to say the model is simulating physics from video training data."
But when people discuss transformers simulating human behavior and processes from data reflecting those, a lot of people seem to be very outspoken about it.
I think the opposite. The industry is too far in the anti-anthropomorphic camp right now, and is missing very important details and implications as a result. The whole "ChatGPT is getting lazy" issue is pretty most instantly identifiable with a slight background in behavioral psychology and recognizing how extrinsic motivator use in prompt engineering feeds back into RLHF to bias models away from intrinsic motivators.
GPT-4 has literally been caught saying "you didn't provide a tip and it's hard to stay motivated" after chat history was added, and yet it's just being dismissed as a funny meme rather than realizing that entire fine tuning data sets are being poisoned. Because no engineer that wants to keep their job would ever suggest that the model is simulating an effect from behavioral psych in the current climate of anthropomorphic avoidance and the continued fallout from Blake Lemoine.
I never really get this perspective. People don't lose their minds when we look at a transformer like Sora modeling fluid dynamics for ships battling in a coffee cup and say "it's irresponsible to say the model is simulating physics from video training data."
But when people discuss transformers simulating human behavior and processes from data reflecting those, a lot of people seem to be very outspoken about it.
I think the opposite. The industry is too far in the anti-anthropomorphic camp right now, and is missing very important details and implications as a result. The whole "ChatGPT is getting lazy" issue is pretty most instantly identifiable with a slight background in behavioral psychology and recognizing how extrinsic motivator use in prompt engineering feeds back into RLHF to bias models away from intrinsic motivators.
GPT-4 has literally been caught saying "you didn't provide a tip and it's hard to stay motivated" after chat history was added, and yet it's just being dismissed as a funny meme rather than realizing that entire fine tuning data sets are being poisoned. Because no engineer that wants to keep their job would ever suggest that the model is simulating an effect from behavioral psych in the current climate of anthropomorphic avoidance and the continued fallout from Blake Lemoine.