Comment by sshh12

Excited to try this once y'all get self-hosting! Super useful that you'll also support structured output and openai style functions for models where it's not supported by the native API (that's been a big painpoint for breaking out of openai).