captainclam

I can imagine that one of the aspects of being social creatures is that we are drawn to the entropy/surprise factor of natural language produced by a brain that isn't our own. Deriving a shared understanding without being able to precisely model the language output of someone else is like, the fundamental substance of conversation.

Maybe that's the key ingredient that's missing from LLM-generated text. Even when there is actual content there, there's this lack of surprise / uncertainty in its delivery that we require to stay engaged. We may not know what will be communicated, but knowing exactly how it will be communicated just kills our innate interest.

Obviously the kid would choose the colorful modern game over some ancient NES game. They would literally choose one of those weird phone games you see crazy ads for over Super Mario Bros.

> "minecraft in skyrim" is cool for about 10 seconds till you think about actually sitting down to play it.

Yeah, it is kinda wild how the infinitude of possibility suddenly makes everything so dull.

> And the thing is, it's not the technology itself, which could be used to produce meaningful art.

Exactly. I am not de-facto against the use of AI in art. But artful use of the medium is sparse at the moment.

> movies are going to become video games and video games are going to become something unimaginably better

God what an annoying thing to say. Suggesting that movies will essentially become games, or that future video games will be unimaginably better (presumably because they are driven by generative world models) betrays such a surface level appreciation for what makes art and culture and all this humanity so beautiful as it is.

The entire point of movies is the deliberate choices of the filmmakers! Movies will not be improved by our ability to choose what the main character looks like or add a style filter. Super Mario 64 is great because it is an expression of the very hardware that constrains it. Inevitable future versions where anything can happen because someone hooked the ROM up to a generative world model won't be better for it.

I agree that this technology is absolutely world changing, and am cautiously eager to see what comes of it, but it just bums me out, perhaps needlessly, that the people at the helm can be so artless, unreflective. Whatever.

100%.

And a corollary being that without any time spent on the "mundane", almost every single aspect of the work becomes the genuinely consequential decision-making steps.

Which I find exhausting.

I completely understand where you're coming from. While understanding the math and architectures of these large models can be edifying, it lacks some of the liberating/empowering spirit of traditional software. You can build a bespoke to-do app that is better suited to your needs than anything produced by some productivity software company, but you're totally beholden to one of the few big players for access to an effective LLM.

But there is so, so much interesting work and research to do at a much smaller scale. I work on drug discovery models, and none of my work requires data or infrastructure that are not generally accessible to the public (it's nice to have the computing resources of my institution but there are other ways to access a GPU).

So if you are really interested in this stuff, I would suggest looking at the endless supply of interesting problems in domains that are not dominated by huge frontier labs.

"The agent could write refund code all day long. What it can’t do is decide what your company owes a customer whose card has expired..."

In 2031: Why on earth not?

These are good points, though OP did specifically say that Meta is going to win "consumer" AI. I don't think the average consumer of AI is going to ever have to think about harnesses or worry about SOTA, they really will continue to interact with whatever is stickiest.

The following certainly does not describe all mathematics or all LLM operations, but its my mental model for why LLMs are so effective in several fields.

Lots of mathematics entails recognizing that a tool/techniques that works in one area can be adapted to a completely different problem. For a human to do this requires having a robust mental model of the technique and the problem itself, and probably having just the "right" mental model to see how they fit together. And we are talking about extremely hard/sophisticated techniques and extremely hard/sophisticated problems, so the ability to deeply appreciate either can require years of study. And on top of that, even if the mathematician has sufficient understanding to develop the intuition that the technique might work, they will need profound fortitude, skill, and patience to see the solution through.

Unlike human mathematicians, who will develop a deep understanding of only a relative handful of techniques and problems in their lifetime, LLMs have ALL written techniques, problems, solutions, etc stored in their internal representations. So when they ably match a problem to a technique, we can imagine the operation as a supercharged autocomplete, or even an extremely proficient search engine. Their stroke of genius is really a consequence of capacity, moreso than cleverness.

Huh. I guess I don't agree that this would at all characterize Tao's relationship with AI. I haven't read a single thing from him to suggest that he is "seething" over AI's remarkable capabilities. In fact he's a prolific user of AI in mathematics research. I don't think the scene serves a useful analogy.

Also Tao's reference to "feeling for" Salieri makes a lot more sense, the audience is clearly supposed to feel for him! That's what makes the scene effective.

And why would I want to see AI humiliate Tao?

I'm sorry if I misunderstood your comment. Thank you for the link, it is useful context.

I replied to a different comment with an explanation as to why I do not perceive Tao as a gatekeeper; in short that his current beat seems to be entirely about expanding understanding and access to math by improving the communication of opaque proofs, which we will shortly have a near infinite supply of due to AI.

I will also mention that he maintains a realistic, clear eyed attitude with respect to the inevitability of AI in math, while being sensitive to its disruptive nature in his field. Everything here strikes me as constructing a thoughtful, grounded way forward for his community.

I'm sure there will be missteps along the way, but I think Tao is overall an excellent example of maintaining a balanced position between the poles of absolutism that seem to capture so many.

I am curious where you interpret this as gatekeeping behavior.

I was not familiar with the mathathon, and I suppose I am ignorant of the circumstances in which Tao allegedly bullied students into changing the event. I don't personally have any reason to doubt the veracity of the "Joint Statement about Mathathon", but perhaps you have some insight that I don't. I will say that I would imagine that any input from Tao, even in passing, probably has outsized influence on the organizational direction of the event due to his preeminence, but I'm not so sure that necessarily rises to the level of bullying.

But from what I gather, the theme of the statement is to expand the scope of participation to include work that is quite literally the /opposite/ of gatekeeping, i.e. taking proofs that are popularly understood to be opaque or difficult to understand (from any source, AI, human, or otherwise) and developing a new way to communicate them that is more accessible to more people.

I do see how it may come off as a slight to the original mathematicians who developed those proofs. But developing new ways to communicate already established concepts should not diminish the original works. There are probably much better communicators/teachers of relativity than Einstein ever was. No one out there thinks any less of Einstein because of Sean Carrol's "Spacetime and Geometry" textbook.

And this to me reads as only embracing the use of AI in mathematics, which is not gatekeeping behavior. Tao continues to emphasize that once proofs become effectively automatable, deeply comprehending and being able to transmit that understanding to others will become an increasingly important aspect of the field, the natural way for mathematicians to use the time that was once occupied by developing the proofs themselves.

Literally all of this is about expanding the accessibility of mathematics, which once again, I perceive to be quite the opposite of gatekeeping. Maybe we have different definitions of that term.

Also I have not seen Amadeus, so no comment about Salieri.

I also work in drug discovery, and I completely agree; the extent to which the actual causal mechanisms of the efficacy of many drugs is woefully short of some human-appreciable first-principles based explanation. The point is especially undercut by hypothetically suggesting that this drug /does/ in fact pass stage 3 trials, at which point I can't fathom anyone would have a problem advancing it.

Really wish he had chosen a different example; this particular bullet point has been making the rounds on X/twitter to paint Tao as an example of some sort of gatekeeping luddite who would deny the world a post-abundance future in order to maintain the prestige of his particular career path...which is tough because I cannot think of a more responsible steward of our inevitable AI future than Tao at the moment.

"If every product is used by an agent driving a CLI, what’s going to differentiate Basecamp or Fizzy from the cheapest alternative?"

At that point, why even bother with "driving a CLI"? I have a hard time seeing how this all doesn't go away soon. At the current trajectory, I am not seeing a future where software like Basecamp or Fizzy or the cheapest alternative are competitive with "Claude, build a basecamp-style project management tool for my team."

I don't mean to say that thoughtfully built, opinionated software doesn't have intrinsic value, I believe it will always be "better" in certain aspects...I just can't fathom that a market for it will exist in very short order.

I would LOVE to be talked out of this perspective.