Get LLMs to hillclimb your wife's treatment. The target isn't exactly verifiable but you could iterate on ways to add verification signals. There's a huge difference between asking an LLM: "hey claude, my wife has cancer, I want your help with x,y,z", which mode collapses it into extreme over-caution; versus setting up the problem like an eval, which sends LLMs into a frenzy trying to solve it no matter what.
Get LLMs to hillclimb your wife's treatment. The target isn't exactly verifiable but you could iterate on ways to add verification signals. There's a huge difference between asking an LLM: "hey claude, my wife has cancer, I want your help with x,y,z", which mode collapses it into extreme over-caution; versus setting up the problem like an eval, which sends LLMs into a frenzy trying to solve it no matter what.
Second thing I can share is the man who created an mRNA vaccine for his dog Rosie's cancer, and it worked! https://news.unsw.edu.au/en/meet-the-man-who-designed-a-canc...