You're right to single out that sentence, or rather that word "all" in "All the interviewing and evaluating will be done in regular HN threads". We didn't stick to that, and I'm sorry. That's precisely what we changed, and yes we changed it at the last minute.
I didn't think of this experiment as having fixed rules, but rather as something we'd figure out as we went along. I tried to make that clear up front: "Note that word experiment! We'll start small and figure it out as we go. But here are the initial conditions." I can see why that wasn't enough.
It occurs to me only now that "figure it out as we go" and "changing the rules" are the same thing. So yes. We changed the rules, and I'm sorry.
I didn't think of this experiment as having fixed rules, but rather as something we'd figure out as we went along. I tried to make that clear up front: "Note that word experiment! We'll start small and figure it out as we go. But here are the initial conditions." I can see why that wasn't enough.
It occurs to me only now that "figure it out as we go" and "changing the rules" are the same thing. So yes. We changed the rules, and I'm sorry.