Not sure whether there's lots of people trying out commands right now (is it backed by a real k8s cluster?), but some commands are taking over 10 seconds to run. Not really a fair "benchmark" when the system's speed is variable.
I also only got "partially_correct" for some, not sure whether it wanted more detail or just didn't like how I phrased things. Neat though.
Success Rate MTTR (Mean time to Resolution)
YOU: 50.00 % 1.80 min
PARITY AI SRE: 70 % 2 min
I also only got "partially_correct" for some, not sure whether it wanted more detail or just didn't like how I phrased things. Neat though.
At least I'm faster than an AI?