Comment

Comment by kevmo314

This list mentions A/B testing a few times and it's worth noting that A/B testing is great but it's not free.

I've seen a nontrivial number of smart engineers get bogged down in wanting to A/B test everything that they spend more time building and maintaining the experiment framework than actually shipping more product and then realizing the A/B testing was useless because they only had a few hundred data points. Data-driven decisions are definitely valuable but you also have to recognize when you have no data to drive the decisions in the first place.

Overall, I agree with a lot of the list but I've seen that trap one too many times when people take the advice too superficially.

parent kevmo314 1 year ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton