pldpld
Joined 15 years ago
Karma
676
Submissions
147
Member since
Mar 10
Recent submissions
Comment · 6 months ago
Comment · 8 months ago
https://voicetest.dev/
https://github.com/voicetestdev/voicetest
- test harness for voice agents. - multi platform formats (Retell, VAPI, Bland, LiveKit) compile down to a unified AgentGraph IR - import from one platform, test locally, export to another - use litellm, DSPY to config models, if on a subscription use claudecode as a runner to avoid API call charges - metric judges produce continuous 0-1 scores instead of binary pass/fail since a 0.65 and a 0.35 both fail a 0.7 threshold but represent very different agent behaviors. - persist to DuckDB for querying across test history - adding auto-healing graph mutations where failed tests propose structural + prompt changes to the agent graph and validate against a regression suite
Wrote up the architecture here https://peet.ldee.org/general/2026/02/03/testing-voice-ai-ag...
Comment · 9 months ago
Thank you! It came out of that feeling of I need to use this, but I don't want to have to manage it or have to learn the details more than once. Now I find myself using it daily in my workflow, not having to worry about the extra worktree folders saves enough time to make it worthwhile
Comment · 6 years ago
Ona | Burlington, Vermont & Nairobi, onsite / remote | Senior Software Engineers, Frontend Engineers | full time | https://www.ona.io/jobs.html
Our global health platform is used on smartphones by community health workers around the world to track and monitor their patients offline and on. Our data and ML platforms analyze patient risk, coordinate humanitarian projects, and manage Covid-19 tracking and messaging campaigns. We were named one of the “50 Most Genius Companies” by TIME magazine and have partnerships with the World Health Organization, the Bill and Melinda Gates Foundation, UNICEF, the United Nations Development Program, the World Food Program, and others.
References: https://blog.ona.io/news/2018/11/16/path-bid-story.html, https://blog.ona.io/canopy/covid19/2020/09/01/how-we-launche...
Our Global Health team stack is Android / Java / Postgres / React
Our Data Platform team stack is Django / Clojure / ClojureScript React (om -> reagent)
Our ML team stack is Beam / NiFi / Kafka / SciPy + Jupyter (prototyping) / Superset
We have full-time positions available, as well as fellowships and other opportunities.
[email protected]
Comment · 6 years ago
Ona | Nairobi, remote | Fellowships / Software Dev / PM | full time | https://www.ona.io/jobs.html
Named one of the “50 Most Genius Companies” by TIME magazine, we are a social enterprise building technology products that improve access to essential, life-saving services. We are funded by the World Health Organization, the Bill and Melinda Gates Foundation, UNICEF, the United Nations Development Program, the World Food Program, and others.
Ona's GIT fellowship is a 12-week, Nairobi-based engagement pairing experienced software engineers with a global health or humanitarian open source project.
Our Global Health mobile team stack is Android / Java / Postgres / React
Our Data Platform team stack is Django / Clojure / ClojureScript React (om -> reagent)
Our ML team stack is NiFi / Kafka / SciPy + Jupyter (prototyping) / Superset
We have full-time positions available, as well as fellowships and other opportunities to contribute, https://ona.io/jobs.html
It imports your agent config from any supported platform into a universal IR (AgentGraph), then runs autonomous multi-turn conversation simulations against it. A simulator LLM plays the caller, your agent graph handles the routing, and an LLM judge scores transcripts against success criteria. Also supports deterministic rule tests for compliance stuff, PII leakage, required disclosures, forbidden phrases.
Write tests once and they work across platforms. Import from Retell, export to VAPI, run the same test suite. Also does format conversion between platforms if you're migrating.
Has interfaces for CLI (CI/CD), web UI, REST API, and a TUI. Results go into DuckDB so you can query them. Uses LiteLLM via DSPy so it works w/whatever provider you want
https://github.com/voicetestdev/voicetest