skepticATX

This discounts the human breakthroughs needed to get to this point, the cost of the employees working in it, previous attempts, and more.

The saddest part of this is no one actually cares about the proof itself.

Does it prove what it claims to prove? Were new mathematics invented? Can this be applied to other areas?

I don’t have a problem with labs solving hard problems if they can, but they could at least pretend to care more about the problems and less about the marketing opportunity.

About 2% of finasteride users experience these side effects, and they are reversible after discontinuation.

> Why aren't employees more honest about AI and concerns regarding it

Because it’s being pushed by the c-suite and board, so most people aren’t in a position to push back. And it’s a quasi-religion now, so even pushing back at all can result in being branded as a “skeptic”.

People do raise concerns, though. And the responses aren’t very satisfactory. For example, the biggest concern that has been raised thus far is open PRs, and the answer has always been that all we need is AI code review.

Yes, I am exhausted. Most of my company is obsessed with agents, because everyone wants to be seen as AI first. There is little thought going into usage. No care for long term maintainability and quality. Our product is actively worse by many metrics, but no one cares because we marketing can say “agents”.

The sad part is that this technology is incredible. It’s us choosing to turn it into a slop cannon (and the labs sure seem to encourage this).

I want to leave the industry as soon as I can.

Maybe I am missing it, but I don’t see where AI solved anything in this anecdote. Rather, a team of medical professionals and a patient willing to advocate for herself did.

The reason that I’m looking for an out is that it’s turned everyone I work with into imbeciles.

Nobody wants to think anymore. Coworkers are now just intermediaries for their LLMs. Talking to them is just talking to the LLM - sometimes directly copied and pasted, sometimes minimal effort to conceal what they’re doing. It is so disheartening.

And the sad part is, LLMs are incredible and can enable you to do much better work if you can stay in the loop, and stop focusing only on shipping speed. But from what I have observed, very few people care to do this. Who cares about substance when middle management thinks your productivity is 10x?

You generally don’t assign work to an intern just for the output, though.

Reviewing code is absolutely different from writing it, and in my opinion much harder if the goal is more than surface level understanding.

This is what I am still grappling with. Agents make more productive, but also probably worse at my job.

One explanation is that this is effectively a quid pro quo, given Brockman’s enormous financial support of the current president.

So much software just flat out doesn’t work that people don’t even notice how bad X has gotten.

I actually think that plateauing is the best case scenario for big labs.

I think there are three broad scenarios to consider:

- Super-intelligence is achieved. In this scenario the economics totally break down, but even ignoring that, it’s hard to imagine that there are any winners except for the the singular lab that gets here first.

- Scaling laws hold up and models continue to get better, but we never see any sort of “takeoff”. In this scenario, models continue to become stale after mere months and labs have to spend enormous amounts of money to stay competitive.

- Model raw capabilities plateau. In this scenario open source will catch up, but labs will have the opportunity to invest in specific verticals.

I believe that we’re already seeing the third scenario play out, but time will tell.

This seems roughly equivalent to liability insurance.

It’s much easier to accept fatalities caused by other humans because there is someone to hold responsible. Will autonomous vehicle companies be held responsible when they cause fatalities?

It also goes beyond just the total number of fatalities. Just like we don’t accept DUIs, we shouldn’t accept negligence or laziness from autonomous vehicle developers even if their product is safer than human drivers.

I think the more interesting question is who will be on the panel?

A group of ex frontier lab employees? You could declare AGI today. A more diverse group across academia and industry might actually have some backbone and be able to stand up to OpenAI.