Comment by edwardfrazer

Thanks, and totally agree! We play around a lot with the idea of creating an action layer for LLMs that's abstract enough for sampling/inherent stochasticity not to cause too many intermittent failures. I think when that infrastructure's solid, it'll be really easy for integrators to deliver cool functionality (as you said :) )