merksittich
Joined 1 year ago
Karma
737
Submissions
86
Member since
Apr 5
Recent submissions
Comment · 1 month ago
> On June 20-21, agents attempted to exploit vulnerabilities in the Australian Institute of Health and Welfare (AIHW), a government statistics agency. The agents were tasked with finding the January 2022 rolling-12-month-average government cost per person for Dermatologicals across Victorian LGAs.
Comment · 1 month ago
I am irked by the CRISPR framing. That seems to be IPO positioning.
Good hypotheses are a dime a dozen in life sciences. Biology is very unforgiving and most hypotheses lead to nothing when thoroughly tested. This is true for something as "simple" as enzymes as in this case, but even more true for curing diseases. Otherwise, there would not be any failures of phase III clinical trials, after billions USD spent on preclinical research and prior clinical trials.
When overinterpreting these (interesting) results, you are entering Andy Grove Fallacy [0] territory very fast.
[0] https://www.science.org/content/blog-post/andy-grove-rich-fa...
Comment · 1 month ago
Even OpenAI's own publication [0] on Navier-Stokes from two days ago appears to contradict "basically solving anything you throw at it". The chart shows a pass rate of ~0.5 (vs. Astra's ~0.2) on "a curated set of open math problems". (Based on the timelines and events described in the publication, I presume that the "Internal Model" in the publication represents OpenAI's latest and greatest model. Evidently, this pass rate may improve in the future.)
Comment · 1 month ago
The x-axis label of the chart is test-time compute. Doesn't this relate to inference ("thinking level") instead of training?
Comment · 2 months ago
> Model 2, which is somewhat more capable than Mythos 5. Our rough qualitative sense is that this model is a noticeable improvement on Mythos 5 for many tasks relevant to internal use but does not display a capability jump of the degree observed from Claude Opus 4.6 to Mythos Preview. We do not currently have plans to release this model externally, and have not run all of our typical suite of predeployment assessments, so we have somewhat lower confidence in our beliefs about its capabilities.