E e10v.me Show HN: Tea-tasting, a Python package for the statistical analysis of A/B tests I'm excited to introduce tea-tasting, a Python package for the statistical analysis of A/B testsIt features Student's t-test, Bootstrap, variance reduction using CUPED, power analysis, and other statistical methods.tea-tasting supports a wide range of data backends, including BigQuery, ClickHouse, PostgreSQL, Snowflake, Spark, and more, all thanks to Ibis.I consider it ready for important tasks and use it for the analysis of switchback experiments in my work. 150 points e10v_me 2 years ago 48 comments
It features Student's t-test, Bootstrap, variance reduction using CUPED, power analysis, and other statistical methods.
tea-tasting supports a wide range of data backends, including BigQuery, ClickHouse, PostgreSQL, Snowflake, Spark, and more, all thanks to Ibis.
I consider it ready for important tasks and use it for the analysis of switchback experiments in my work.