dmckinno
Joined 12 years ago
Joined 12 years ago
While I haven't published my results yet (dang OpenAI beat me to it!), they are very similar and I have no doubt that this technology will significantly improve the detection and diagnosis of rare disease, which is a nice win for humanity.
I'm in the process of getting my first batch of long reads, but I am skeptical that this is the "just" what's needed. There is little doubt that long read > short read, but I think that computational techniques for both need to be improved significantly.
There is already some clinical evidence to support my hypothesis. The first clinical long read trial at Kansas City Mercy showed a 10% bump in diagnostic rate, which is great but not fully solving the problem: https://news.childrensmercy.org/unlocking-answers-faster-chi...
Your assumption is correct about my technique. I cloned (and expanded) this workflow into an LLM harness, so the LLM is basically orchestrating a bunch of tools that normally humans would use (and writing the conclusions and doing all the standard LLM stuff).
I wouldn't say anything is automatic or taken for granted, but it is actually relatively common for more thorough reanalysis to uncover something that the first pass missed. I hinted at this in the post, but the reason that this doesn't happen today is human bandwidth.
A core part of my thesis is that that this highly specialized human bandwidth can be scaled with AI.
It may work. It may not work. But I would feel bad if I didn't give it a try.
> Happy to see it. I wish you all the luck and will be the first one praising your solution if I see convincing results.
Appreciate that! Hopefully, they will come.
If you are open to chatting about your experience, I'd love to hear from you. I spend a lot of time learning from and supporting other rare disease families these days.
And the anti-natal thing was kind-of joking not joking. I do know lots of people with kids there now, but when my wife first got pregnant, we were alone.
I'm planning on getting one out in the next few weeks characterizing the system and how it performed on real clinical use-cases vs. alternatives and existing tools.
The TL;DR is that Gamow Labs is a harness and interface company on top of SOTA LLMs as you suggested, but my harness and interface outperforms the existing thing. While this approach would have earned me the "wrapper company" label last year, I hope the success of OpenEvidence, Harvey, Perplexity, and so on has opened minds with respect to the value here.
It was only working through clinical cases that I realized how much more I needed beyond dropping raw reads into Codex.
https://openai.com/index/diagnose-rare-childhood-diseases/