LLMs are intended to model language. This is clear by observing how people expect them to respond when asked questions. The implementation of that model is akin to “pick the next word with highest probability”.
In some contexts, this is absolutely the wrong thing to do. In some contexts the LLM will give you totally the wrong sentiment, or even an incorrect fact. Humans call those “misalignments”, or “hallucinations”, or whatever other softened or anthropomorphised language to play down the problem. The reality is that sometimes they are wrong. The model is wrong.
LLMs are intended to model language. This is clear by observing how people expect them to respond when asked questions. The implementation of that model is akin to “pick the next word with highest probability”.
In some contexts, this is absolutely the wrong thing to do. In some contexts the LLM will give you totally the wrong sentiment, or even an incorrect fact. Humans call those “misalignments”, or “hallucinations”, or whatever other softened or anthropomorphised language to play down the problem. The reality is that sometimes they are wrong. The model is wrong.
It is not an abuse of notation at all.