Comment

Comment by Loquebantur

They have maxed out the base data with the given model architecture and scale "intelligence" through inference-based RL.

Notably, in order to achieve a specific quality, the model has to "reason" for every prompt proportional to the training inference.

This is arguably the case of diminishing returns being reached, as answer token prices saturate the willingness of customers to pay.

They've run into a wall.

parent Loquebantur 22 hours ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton