Comment by minimaxir

A/B tests only work if the subjects don't realize they are in a A/B test.