Comment by rovek

Leaving them in the room to complete the tasks was an early red flag here. If you have no insight into how people think about and complete tasks then you are testing the product of their time, not their approach to problem solving. You then shouldn’t be surprised by the lack of what you didn’t test for after the fact.