Comment by CapsAdmin

Something that bugs me about these new demos is that they benchmark the model and harness at the same time. The harness steer the model to expand the vague prompt, self correct with tools, etc.

I think it's useful when evaluating "model+intended harness", but I'm more interested in seeing raw model improvements than harness improvements.