It's as hard a problem as coding: OpenAI could put all their resources in it and still be in dimensionally the same place as coding is today (much progress but not entirely solved).
So diverting significant resources is just going to harm the main goal and kind of suck at the side goal too.
4.5 is a great example of this: it wasn't perfect but it was better than every 5 family model at things like tone and writing, and despite being priced extremely ruthlessly and already finished training, they couldn't afford to tie up the resources to host it.
So diverting significant resources is just going to harm the main goal and kind of suck at the side goal too.
4.5 is a great example of this: it wasn't perfect but it was better than every 5 family model at things like tone and writing, and despite being priced extremely ruthlessly and already finished training, they couldn't afford to tie up the resources to host it.