Once at a programming conference, I was talking with a very senior developer at a well known company. He was going on and on about their A/B testing efforts.
I asked how they decided how long they would run an experiment for. The answer was "until we get a significant result."
I was shocked then, but now I am used to getting these kinds of responses from developers ... That and a belief that false positives are not a thing.
I asked how they decided how long they would run an experiment for. The answer was "until we get a significant result."
I was shocked then, but now I am used to getting these kinds of responses from developers ... That and a belief that false positives are not a thing.