Comment by lukaesch

Not local. Inference is the only part not written in Rust so far.

I am using Replicate to run docker images with a pipeline based on faster-whipser, VAD, pyannote and a custom LLM enhancement flow.

Thanks for sharing candle/ort. Interesting to see the WASM in-browser opportunities