Comment

Comment by this_steve_j

What are some ways to avoid common methological pitfalls when generating test cases for "groundedness" benchmarks with automation?

Confirmation bias is one obvious pitfall that comes to mind, but also I wonder how it is possible to achieve reproducibility when the input is stochastic.

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton