I really wish I could see the results of this without RLHF / alignment tuning.
LLMs actually have real potential as a research tool for measuring the general linguistic zeitgeist.
But the alignment tuning totally dominates the results, as is obvious looking at the answers for "who would you vote for in 2024" question. (Only Grok said Trump, with an answer that indicated it had clearly been fine-tuned in that direction.)
LLMs actually have real potential as a research tool for measuring the general linguistic zeitgeist.
But the alignment tuning totally dominates the results, as is obvious looking at the answers for "who would you vote for in 2024" question. (Only Grok said Trump, with an answer that indicated it had clearly been fine-tuned in that direction.)