Yeah. What I think is deceptive is something like solving Navier-Stokes with $10M of compute. The bigger question is how many conjectures and hypotheses they tried, and what fraction of those actually succeeded. If they expended say $1B on various open problems, and only 1% succeeded, is that the kind of investment that one will make? (The $10M alone is more than what would have been devoted to academics investigating these issues. But realistically one has to quantify the cost of the entire enterprise, and the probability of success vs failure.
From OAI we're hearing only about 700+ successes. Relative to what failure rate? The cost of success isn't merely the cost of each success, but rather the overall cost of all experiments, of which -- I'd guess -- a huge fraction failed.
From OAI we're hearing only about 700+ successes. Relative to what failure rate? The cost of success isn't merely the cost of each success, but rather the overall cost of all experiments, of which -- I'd guess -- a huge fraction failed.