The issue isn’t with people in the LLM space knowing what is happening. It’s with normal or less-technical people believing that the LLM is actually thinking. We can understand the difference, but that doesn’t mean we need to encourage the misconception.
Non-technical people believing that these models are actually thinking can lead to all sorts of inappropriate uses.
Non-technical people believing that these models are actually thinking can lead to all sorts of inappropriate uses.