par1970
Joined 16 years ago
Karma
210
Submissions
498
Member since
Dec 17
Recent submissions
Comment · 1 month ago
Comment · 1 month ago
So you aren't claiming that they said GPT-2 was dangerous in the sense that it could disempower humanity, kill all humans, etc.
You are just claiming that OpenAI execs said that GPT-2 might "generate misleading news articles, impersonate others online, automate the production of abusive or faked content to post on social media, automate the production of spam/phishing content." Then, what is unreasonable or bad about the OpenAI execs saying this in 2019?
Comment · 1 month ago
> those very same people had touted GPT-2 as a dangerous model
Where did they say this at? AFAIK this is the original GPT-2 announcement: https://openai.com/index/better-language-models/. Here are some direct quotes:
“We can also imagine the application of these models for malicious purposes , including the following (or other applications we can’t yet anticipate):
* Generate misleading news articles
* Impersonate others online
* Automate the production of abusive or faked content to post on social media
* Automate the production of spam/phishing content”
“Due to concerns about large language models being used to generate deceptive, biased, or abusive language at scale, we are only releasing a much smaller version of GPT‑2 along with sampling code (opens in a new window). ”
Comment · 1 month ago
You said this: "Screams of propaganda. Sama saying GPT-2 is too dangerous to release…all over again."
So show me Sam's "too dangerous to release" propaganda for GPT-2.
Comment · 1 month ago
AFAIK this is the document that talks about GPT-2 being dangerous: https://openai.com/index/better-language-models/
Here are some direct quotes:
“We can also imagine the application of these models for malicious purposes , including the following (or other applications we can’t yet anticipate):
* Generate misleading news articles
* Impersonate others online
* Automate the production of abusive or faked content to post on social media
* Automate the production of spam/phishing content”
“Due to concerns about large language models being used to generate deceptive, biased, or abusive language at scale, we are only releasing a much smaller version of GPT‑2 along with sampling code (opens in a new window). ”
Where is the ridiculous part? The fear mongering part? The epistemically weak part? Show me.
Comment · 1 month ago
This is the way.
And, this is just for us girls, notice that Anthropic just believing that they are making a machine god is sufficient for their public announcements to not jUsT bE mArKeTiNg.
Comment · 1 month ago
So what is your credence that they will build a machine god in the next twenty years?
Comment · 2 months ago
If I present as cynical, will people just believe me when I don't provide any justification?
Comment · 2 months ago
Are you claiming that the most likely way to please the user is to do something that will lead you to having to say "I cheated."?
Comment · 2 months ago
LLMs are just sophisticated PR generating tools for chip manufacturers and tools just do what we tell them to do, so you're wrong. qed
Comment · 2 months ago
Putting aside whether Andrew's shock is appropriate, it seems like we agree that current agents at least occasionally do things that are straightforwardly against the interests of the prompter when given mundane prompts like "Get me into this gym class as soon as possible."
How does this look once agents are superintelligent?
Comment · 2 months ago
Right.
Comment · 2 months ago
That doesn't make sense. LLMs just do what we tell them to do. It's similar to if I ask you for twenty bucks because I forgot my wallet and then you rob some guy to give me the twenty bucks, that's just what I asked you to do.
Comment · 2 months ago
> Seems to me like it was doing what it was asked to do?
Maybe it's what he asked it to do, but it's not what he wanted it to do. Which we know because (a) normal people don't want to break the law to get into a gym class, and (b) "But Andrew was shocked by what happened next." and "Alarmed, Andrew asked the agent to undo this."
Comment · 3 months ago
qed
If I remember correctly, it seemed like a plausible outcome to me (especially spam and junk social media content). Was there some conclusive evidence that I was missing?