Tay got that way because it was effectively fine-tuned by an overwhelming number of tweets from 4chan edgelords. that's a little more extreme than "no guardrails," it was de facto conditioned into being a neo-Nazi.
a generic instruction-tuned LLM won't act like that.
a generic instruction-tuned LLM won't act like that.