Comment by dsaffy

Yeah we totally agree. That's why we work on the end-to-end app, not on a single prompt. You pick what parameters become knobs in the frontend. So if you have a giant app with 10 parameters (say 5 prompts, 5 numbers), great, wrap those and they become knobs on our frontend. We override during the actual end-to-end testing execution kinda like a Statsig / Launchdarkly (only with typing).