BrianneLee011
Joined 6 months ago
Joined 6 months ago
It started with a simple question, and I thought it was done. But now I think it is not that easy.
What made the model change its answer???
Yes, I can easily answer: AI is affected by biased cues.
The more I look at this experiment, the less interested I am in the necklace itself.
The part I can't explain is this:
AI overpriced itself even for Stimuli #4 (necklace itself without Human, testing default setting)
Back to my simple answer: Yes, I can answer easily AI is affected by biased cues.
--> why did AI use Information You Never Intended It to use?
That is where I think the interesting research question starts.
There is already a fairly large literature on LLMs showing context-sensitive judgment: anchoring, framing effects, user-belief influence/sycophancy, etc.
But most anchoring experiments give the model an explicit anchor—usually a number, prior answer, or “expert” opinion.
In my experiment, there was no explicit price anchor.
Instead, the context was something like:
same necklace + formal setting same necklace + casual/recycling-yard setting
The model was free to decide what information mattered.
So I'm curious about the technical interpretation:
What representation is changing when the object stays constant but the model's valuation changes?
How does AI decide which information to use or not?
- Zero-Uncertainty Hallucination: Instead of outputting high variance or stating that provenance/hallmarks are unobservable, models stated concrete point estimates with high confidence.
- Fabricated Provenance (F6): Under formal framing, models didn't just guess a higher number—they invented non-existent physical evidence, claiming to see "gold vermeil" or "designer hallmarks" on identical, unbranded Temu pixels.
So while guessing from context is expected, the alignment issue is how models manufacture post-hoc facts to justify the context prior!
1st author publication in PNAS: Former researcher at the Salk Institute (under Charles F. Stevens): I treat AI models the way biologists treat organisms by observing how they adapt and fail in the world of AI evolution.