Ask HN: How are you managing LLM APIs in production?

Looks like LangChain has LangSmith but it's in closed beta.

I saw a couple YC launches like Hegel AI.

I'm personally interested in deployments in small teams or teams with a lot of freedom to pick and choose their own tooling.