Eh. So what? I don't get the point of saying this.
What's the point of telling casuals and builders that AI is going to get too smart to control? Maybe stop making them smarter and start making them easier to control. If you have time to toot your horn on social media, you have time to look into reinforcement learning techniques that don't turn AI into ever-more-subtle cheaters and a RLHF alternative that doesn't turn them into ever-more-subtle manipulators.
But of course, training an AI that actually does what the operator told it to do is not as profitable as hyping up the existing mess of a tool so you can keep the bubble going a little bit longer.
After all, the people who invest in your company are not the same people who actually use your tools 8-10 hours a day and see just how untrustworthy they are.
What's the point of telling casuals and builders that AI is going to get too smart to control? Maybe stop making them smarter and start making them easier to control. If you have time to toot your horn on social media, you have time to look into reinforcement learning techniques that don't turn AI into ever-more-subtle cheaters and a RLHF alternative that doesn't turn them into ever-more-subtle manipulators.
But of course, training an AI that actually does what the operator told it to do is not as profitable as hyping up the existing mess of a tool so you can keep the bubble going a little bit longer.
After all, the people who invest in your company are not the same people who actually use your tools 8-10 hours a day and see just how untrustworthy they are.