pizzly

I think many people will be quite content not merging with AI and having AI do everything for them. Perhaps only a small subset of people will want to merge with AI. They may not be allowed to though, if majority of people fine not merging then they may ban those who want to merge.

The subset of people who will want to merge will be people who will not be content with having no control over their future. No ability to create new inventions, new discoveries, new ways of working. They will not be content with just having everything provided to them, playing the social games that will remain and think their environment is a prison.

The question is how long before machines can exceed humans in every way and how long will it take before legal and cultural restrictions allow this to happen. It still could be a long time away and jobs will probably increase in the short/medium term as AI unlocks more what humans can do at a rate faster than AI can automate away.

But lets consider what that end state could look like when machines exceed humans in everyway, what good are humans?

One possibility which I don't particularly enjoy is humans will be good for status games, art, creativity, story telling, IRL experiences, everything that involves human to human interaction and connection with other humans. If AI can supply everything in abundance than like rare cards there is only so many humans in the planet at any particular time then human's value increases. I really do believe connections with other humans will have a premium. As a nerd who is borderline anti-social, non artistic, creative, etc this does not appeal at all to me and properly to many others who read HN as well. For the majority of other people with some adaption time I think they will be fine. They were fine adapting to hunters and gathers to agricultural society, they were fine adapting to agricultural society to industrial society, they were find adapting from industrial society to information society and they will will be fine adapting from information society to the social/creative economy. Some short term pain but overall most people will accept this reality quite readily. Those born into it will not even know what we talking about.

Isn't detecting cancer predicting a possible future? Hopefully one you can change.

This contradiction "we have to make an agreement with China for mutual slowdown" but also "we have to ensure we will always stay ahead of China" would work. Its just fantasy. The only way to enforce this is with military force and the cost would be too unbearable. You could try trade restrictions but the previous tariffs did not work and doubt future ones will to. US citizens (and thus politicians) won't bear that pain. Thus at a minimum this contradiction will mean AI will continue to develop until both US and China are at the same level. Playing with logic gives you possible scenarios. If China catches up within 1 year then negotiations could begin. If China takes many years to catch up, say 6 months behind now, then next year 5 months behind, then year after 4 months behind then expect overall AI development to proceed at full speed. The one way you could do it is to negotiate to transfer direct technology to China that will ensure that they will have the capability to be on par with USA. Politicians won't do this publicly as they want to get elected but they could make a deal that appears to appeal to both sides while actually transferring technology.

I think the only way they could actually pace the frontier is if they restrict the number of GPUs and the power of GPUs available to each person/organization. Licenses would be needed for GPUs above a certain power or equivalent in terms of number of GPUs. Thus, everyone will have to register how many GPUs they have. To enforce this countries would have to use mass surveillance (using AI) on their citizens to ensure compliance as the technology is easier to develop than say nuclear weapons. Next stronger countries capable of having advance AI won't be able to trust weaker countries as they don't know how they will use the GPUs they receive (or even build). Thus like nuclear non-proliferation strong countries will ban weaker countries from having powerful GPUs. If you from a weaker country then too bad for you.

I don't think I would like this future.

I think AI companies making a point is not the only thing at play. Discovering new maths ultimately leads to new technologies and applications. It may start theoretically but end up being of practical use in the future. Even if humans do not understand it (lose interest, too complex, or just way too many new proofs to go though) AI can use this AI derived math corpus which will help it in other fields.

I would expect this for service providers that provide their "free" services but the mathematicians said they paid OpenAI to help generate this result. This is a clear conflict of interest. Similar to inside trading. Or the same lawyer being hired from two opposing sides which is a big no no. There are rules and laws that already deal with this in other industries and I expect that there will have to be regulation developed for cases where there is a conflict between AI customers and AI provider interest.

Also add corporations. Insurance companies, Banks, Potential Employers, etc will definitively use mass surveillance and AI generated predictions based on that mass surveillance.

Wouldn't the better way be is to make social media open? i.e. anyone can generate their own algorithm or chose from others who created them. I see that the social media companies could implement these requirements in the worse possible way to ensure that they opt right back in to "choose to opt in to having their default feed include personalised content recommended by the algorithm"

From another country but this is the excuse they use here with some paraphasing. "We have decided not to proceed with your complaint ... It looks like your complaint was generated by AI, it is large in volume and confusing. This is the final decision." This was after confirming every single law was valid, referenced, previous case history also properly referenced, added our points, etc. The funny thing is that they only mentioned AI use as a reason to terminate the investigation after many back and forward emails discussing points that they could understand quite well and we pushed back on. Our last response proved beyond a doubt that the opposite party (also another government department) lied to them. For another complaint for a another government agency straight away told us not use AI and use simple words and not to quote the law as that is not how its done in this country. However, we won that one right before telling them we would self represent in court after many back and forward emails with them saying don't use AI each time.

From what I see multiple government departments are already pushing back from people using AI when dealing with the government. I understand the dynamics, if the cost of exercising your rights go down, more people do it and their budgets cannot cope. However, you then abuse the rights of the citizens. Regulations are designed to protect the most vocal people or the wealthy. The most vocal people can start a revolution (or get another party elected) so need to please them while the wealthy are the ones in power. I don't know how this will play out.

Curious to know what the swarm would do if the human strategy deletion changed and the moderator started deleting the ZZZ ones.

Wheres the limit. Would a prompt "Create a system that does x" and no other feedback count? Or do need to do 10 prompts to steer your agent to the results you want. What about just 1 additional prompt. Somewhere there will be a line.

Perhaps but what about individual works done not via a company. Say you are a author and someone falsely detects a AI watermark in your book. Is the testimony you provide enough to override that falsely detected AI watermark? My feeling is that there will be an industry that arises that proves you contributed to the works you want copyrighted.