Recent submissions

Comment · 9 months ago
I think we have to be careful when assuming that model capabilities will continue to grow at the same rate they have grown in recent years. It is very well-documented their growth in recent years has been accompanied by an exponential increase in the cost of building these models, see for example (of many examples) [1]. These costs include not just the cost of GPUs but also the cost for reinforcement learning from human feedback (RLHF), which is not cheap either -- there is a reason that SurgeAI has over $1 billion in annual revenue (and ScaleAI was doing quite well before they were purchased by Meta) [2].

Maybe model capabilities WILL continue to improve rapidly for years to come, in which case, yes, at some point it will be possible to replace most or all white collar workers. In that case you are probably correct.

The other possibility is that capabilities will plateau at or not far above current levels because squeezing out further performance improvements simply becomes too expensive. In that case Cory Doctorow's argument seems sound. Currently all of these tools need human oversight to work well, and if a human is being paid to review everything generated by the AI, as Doctorow points out, they are effectively functioning as an accountability sink (we blame you when the AI screws up, have fun.)

I think it's worth bearing in mind that Geoffrey Hinton (infamously) predicted ten years ago that radiologists would all be out of a job in five years, when in fact demand for radiology has increased. He probably based this on some simple extrapolation from the rapid progress in image classification in the early 2010s. If image classification capabilities had continued to improve at that rate, he would probably have been correct.

[1] https://arxiv.org/html/2405.21015v1 [2] https://en.wikipedia.org/wiki/Surge_AI

Comment · 1 year ago
I wonder whether for a lot of the search & literature review-type use-cases where people are trying to use GPT-5 and similar we'd honestly be much better off with a really powerful semantic search engine? Any time you ask a chatbot to summarize the literature for you or answer your question, there's a risk it will hallucinate and give you an unreliable answer. Using LLM-generated embeddings for documents to retrieve the nearest match, by contrast, doesn't run any risk of hallucination and might be a powerful way to retrieve things that Google / Bing etc. wouldn't be able to find using their current algorithms.

I don't know if something like this already exists and I'm just not aware of it to be fair.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton