Comment by wallawe

If anyone finds this in the future, we found three solutions we're evaluating:

https://www.promptlayer.com/

https://freeplay.ai/

https://www.helicone.ai/