fsndz

> AI-generated text has none of that effect on me. My brain just shuts down as soon as it detects it. My eyes glaze over and my fickle attention flickers away.

Does this apply to all AI-generated text? Don't you use ChatGPT or Claude, and thus read AI-generated text?

A few days ago, I asked myself this question: “What happens when AI can say what you want to say better than you?” That question only scratches the surface of the malaise. For more than a year now, I have struggled with what to do, as someone who likes to write, when writing becomes ‘cheap’. Or should I say, to be more precise, that it is actually generating written artifacts that has become easier. There is a feeling that, now that one can write enormous amounts of blogs, essays, and reports, each one becomes less valuable. Text is no longer rare and precious like in ancient times. Just as synthetic diamonds are killing the natural diamond market, there is a sense that the synthetic writings we currently have wide access to are degrading the value of traditional human writing.

expertise at navigating accidental complexity can easily be mistaken for engineering expertise.

As part of the Holistic Agent Leaderboard (HAL) initiative at Princeton CITP, we evaluated more than 220 agent runs across 9 benchmarks, the equivalent of over 20,000 agent rollouts across 9 models and 9 benchmarks for a total cost of $40,000. The benchmarks are: AssistantBench, CORE-Bench Hard, GAIA, Online Mind2Web, Scicode, ScienceAgentBench, SWE-bench Verified Mini, TAU-bench Airline, and USACO.

In that process, we “burned” 2.6 billion prompt tokens and learned a lot along the way. In this article, I’d like to share some of the insights we gained, with a particular focus on the GAIA benchmark.

Exactly. I think the study is a good reminder that we really have to be careful about the productivity gains attributed to AI. Main takeaway imo, despite limitations from the study, is AI is not a panacea, it can increase productivity, but only if used 'well' and with the good workflows in place, and in the right context.

I mean, hacker news is still the same aren't they using AI to completely make this website more of whatever it was before ????