ljclifford
Joined 4 years ago
Joined 4 years ago
the core issue is prosody: kokoro and piper are trained on read speech, but conversational responses have shorter breath groups and different stress patterns on function words. that's why numbers, addresses, and hedged phrases sound off even when everything else works.
the fix is training data composition. conversational and read speech have different prosody distributions and models don't generalize across them. for self-hosted, coqui xtts-v2 [1] is worth trying if you want more natural english output than kokoro.
btw i'm lily, cofounder of rime [2]. we're solving this for business voice agents at scale, not really the personal home assistant use case, but the underlying problem is the same.
Kinda funny how many amazing CX companies start in Germany!
I’m the CEO & founder of Rime, so I’ve been following your progress with real interest. Feel free to reach out and I’d love to explore ways we might collaborate. Until then, wishing you tons of success on this big milestone!
If you're curious what's possible with <.01% of the funding, check out https://rime.ai/. We train on data recorded in our studio and specifically include a lot of currency in our scripts for this very reason.
[disclaimer: one of the founders of Rime]