otakucode
Joined 16 years ago
Joined 16 years ago
There are many ways to communicate ideas, and most people in most situations rely not upon proofs derived through deductive logic. They rely instead upon persuasion, intuition, and building associations between ideas. Those tactics are in many ways more natural (as in, fairly direct consequences of brain structure rooted in biology) but with known flaws. LLMs are pure persuasion, and operate entirely in that realm. They can be cajoled into repeating logically unsound ideas in much the same ways humans can. And, they can do the same back to us.
My concern is that having one model generate a paper, and then using another model to explain and answer questions about the paper, could run the risk, especially in arenas where the number of individuals with deep deductive knowledge of the subject is small, of optimizing for persuading those individuals rather than proving real results to them. Since it's reasonable to presume the model has been trained on other explanations which have convinced the expert, and on convincing people generally (which, on balance, uses more flawed intuitive explanations to persuade rather than prove), it should be very good at least at creating an environment where the expert would need to practice extreme skepticism and fully utilize critical thinking to attack every element of every claim. That can be very challenging.
No, not companies of "all" sorts. Just insurance companies. Other companies are regulated by Congress as part of antitrust regulations which would prevent them from doing this kind of thing. Insurance companies, however, are not regulated by antitrust laws. Insurance is declared to be "not commerce" and therefore not answerable to antitrust laws. They are permitted to break any antitrust law they please. This is why medical insurance companies, for instance, hold national meetings every few years to decide what price they are willing to pay for medical goods and services. This is price-fixing, and it is illegal in absolutely any industry - except insurance. In insurance, they can do it publicly because there literally is no law against it. There's a law PROTECTING it. It was called the McCarran-Ferguson Act. The plan was to repeal it as part of the Affordable Care Act. It was the clause that enabled the ACA to survive the entire revision process... and was then promptly removed from the bill immediately before its passage. This is why the insurers have never really fought very hard against the ACA. If it ever gets repealed, the McCarran-Ferguson act, that is, insurance companies will fall under antitrust regulation and have to change almost every business practice they follow. They will have to compete against one another on price, compete against each other on what prices they pay, etc. It would destroy their profit margins and probably result in the majority of them going out of business quite quickly. Don't hold your breath. It's why the insurance industry spends so much on lobbying and every lobbyist for every single industry will fight its repeal. In other words, it will NEVER happen. The law has been in place since 1945.
Nodes which are actually important are 'bridge' nodes that provide a means of moving between mostly-disconnected groups. I started wondering what these ideas looked like in an actual social graph, like society. What would 'bridge' nodes look like, and what would eliminating the connection to them look like and what effect would it have? I think a social bridge node would be something like a biker whose main social group is his motorcycle gang, but who also participates in his elderly aunts knitting circle once a month. He provides a means through which ideas and concepts and information can flow from biker gangs, and those connected to them, to a group of elderly ladies and those they are connected to. They are, almost by definition, tenuous links. Ones which, if someone had influence over the communication networks they were using, it might be very easy to disrupt. What consequences would there be to breaking those links on a large scale? In the '6 degrees of Kevin Bacon' situation, you can get the average number of links needed to get to Kevin Bacon up over a dozen by only removing a couple handfuls of bridge nodes.
I think doing such a thing on a real social graph could be very quiet, possibly undetectable (drop messages from rarely-connecting pairs of users... they rarely connect, so how many of them will go through the trouble to re-establish contact? Have bridge nodes have something go haywire and they have to be issued a new phone number, 'their facebook got hacked', etc). And the consequence would be to freeze most things in place, or at least radically slow down any kind of large-scale social change. Disruption of the status quo on the scale of regime change in a government, say, requires buy-in from large and very mostly-disconnected segments of the population. If only pockets of people are interested in change, it doesn't matter how intensely they want the change to happen, it only matters if they can join forces with very disparate compatriots. If you had high-level control of communication networks and a vested interest in guarding the status quo against large-scale social upheaval, you could probably do it very quietly and without really needing anything more than the metadata of connectivity. No need to find out what ideas are being spread, you could just make sure ALL ideas remain trapped in their own little bubbles or that their spread is greatly contained.
Quote I like:
"Make game of that which makes as much of thee" -- Omar Khayaam