Comment by mistercow

If you do an A/B test and get a result that leans one way but is statistically insignificant, then it seems to me you might as well just go with that answer. No, you don't have good reason to believe that it's better than the alternative, but you do have good reason to believe that the choice is harmless.