Comment by jimmaswell

It matches the reality of my experience using a good frontier like Sol on high to ultra thinking. If it has any way to verify its work whatsoever, it eventually gets to a working and sanely-engineered solution. Blatant hallucinations making it to the final stages have become extremely rare in my use cases, nonexistent if the model has a valid feedback loop. So yes, I will insist someone is likely "holding it wrong" if they still think SOTA AI is spewing out garbage at this stage when I can have it do something like write entire working kernel module fixes for old MacBooks on a whim with no crashes or flaws observed after months of use.