Comment by jakswa

llama.cpp looks to be cloning openai's realtime websocket API with this audio model as its first use case? I guess this model is either the first speech-to-speech of its kind, OR it's the first good-enough one. I'm thinking I need to give this more testing!

  - https://github.com/ggml-org/llama.cpp/pull/31287
  - https://github.com/ggml-org/llama.cpp/pull/31269