Comment by jlawrence6809

Yeah no one can predict the future but betting on progress tends to be a better heuristic with technology, especially in AI given the rate of current progress. And as far as I know the availability of (human generated) training data isn't a strict requirement for further progress given test time scaling. The way I see it is we're still running these models on hardware mostly designed before the LLM revolution so we'll be seeing massive gains in, at the very least, the speed and cost of the current frontier models in the coming years which will make all sorts of things possible. I also think it's more likely than not they will keep improving in capability at some rate and the things software engineers are complaining about now will be seen by the labs and worked on deliberately if simply scaling the models itself isn't enough.