enoch_r
Joined 14 years ago
Joined 14 years ago
Convincing a human law professor to click the "I would prefer to deliver this response to a student" button, and to not click the "this response is pedagogically harmful" button is a different task!
I could imagine an LLM convincing a typical human to click the "I like this one better" button with flattery, or with nice-sounding platitudes, or with hand-wavey explanations that sound plausible. And in fact that's exactly what LLMs do when they go wrong - they bluff and output superficially plausible nonsense!
But these weren't typical humans, these were law professors specifically tasked with deciding which response was a better option to give to students as a canonical answer to a contract law question. So I think this is a genuinely impressive result.
1. some people argue that the implication of this (along with other deaths of science-adjacent people) is that there's a murder campaign against scientists
2. but this "implication" is actually completely innumerate, and in reality the implication is something like "within a large population, you would expect some people to be murdered or commit suicide."
I looked at the whole context of responses to the post before my post, so (1) seemed obvious to me, and I was mostly following on with (2), but I see that it was confusing. :)
When you write it out like that, it's obvious that the denominator is ridiculously large and that it would be much more difficult to explain a lack of deaths in such a pool over a ~3 year period.
The missing worker here is typically included in the lists of "suspicious deaths" because she was an administrative assistant at Los Alamos (a government lab).
- Anthony Chavez was a foreman supervising construction at Los Alamos. Retired in 2017.
- Melissa Casias (from this article) was an administrative assistant at Los Alamos.
- Steven Garcia was a "property custodian at KCNSC."
- Jason Thomas was associate directory of chemical biology at Novartis (pharma company) on cancer treatment.
- McCasland retired 13 years before he went missing.
- Nuno Loureiro was a plasma physicist at MIT.
So the denominator here has to include:
- current and former employees (at all levels, including clerical positions like Melissa Casias or construction workers like Anthony Chavez) of government research facilities
- management at pharmaceutical companies (or presumably, other STEM companies as well?).
- academics working in STEM fields (MIT plasma physicist Nuno Loureiro)
So you have to ask yourself two questions:
- how big is the pool that we're drawing these deaths from? and
- given a pool of this size, how many people in it would you expect to die in a ~3 year period?
To me the answer is really boring - this number of deaths is just utterly unsurprising. It honestly doesn't even rise to the level of being a "coincidence." It's a complete non-event.
Here are several articles about denial increases in the time immediately following Thompson's death:
- https://www.os-healthcare.com/news-and-blog/denial-rates-are...
- https://www.experian.com/blogs/healthcare/state-of-claims-20...
- https://www.os-healthcare.com/news-and-blog/denial-rates-are...
- https://www.experian.com/blogs/healthcare/state-of-claims-20...
- the experts have told people to use car seats
- experts wisely base policy on "all of the data"
- therefore, "all of the data" must support the claim that car seats save lives
If we're going to discuss the question of whether experts have set policy well or poorly in a particular case, then such a strong prior on "experts always set policy well and based on the best available evidence" kind of assumes the conclusion, doesn't it?
- a small reduction in minor injuries,
- worse childhoods and parenting experiences (difficult to quantify, but real),
- and a few hundred thousand fewer children being born in the first place,
- very few, if any, lives saved?
If yes, then cool - but I strongly disagree.
If no - then I think the evidence and details very much matter, and that's why I was happy to invest my time in them.
What articles did you find, exactly? What primary evidence are they basing their claims on? Many of the numbers you'll find with a google search are unclear about what they're comparing to - I believe both of the fatality numbers above (71% and 54%) are relative to completely unrestrained kids, which is not the relevant comparison.
The 45% number I specifically discuss in the other comment, but every independently reproducible study using publicly available data has found much smaller effects, around 10-25% for minor injuries and no statistically significant difference in severe injuries.
To be clear, I'm not saying "don't use car seats," I'm saying that the evidence doesn't support mandating them through age 8 (or 12!).
Our kids would be much safer if we drove everywhere at 15mph - less convenient, but it would prevent many unnecessary deaths. Unfortunately, it is impossible to do anything in the world without risk. So we're forced to balance convenience against safety every day, whether we want to admit it to ourselves or not.
- travel with many kids (nope, physically can't carry 4 car seats plus luggage)
- using a taxi, e.g. to go see a movie (nope, can't carry a car seat into the theater)
- carpooling with other families (I'll drive them, you pick up? Nope, we'd have to shuffle car seats around.)
- rides with grandparents or other family members (sorry, we'd have to deliver the car seat to them first)
- splitting kids between two vehicles for errands (let's spend 10m wrestling car seats from one car to the other first)
The whole texture of independent childhood is altered by car seat mandates! Everything gets filtered through "is there a car seat available?". If you haven't experienced this, it's hard to describe - and I think it's absolutely a case where tradeoffs like "how will this affect quality of life?" are completely overridden because "well, if it just saves one life..."
Furthermore, the evidence that car seats actually benefit safety is significantly less robust than you might think. The "mountains of evidence" that do exist for things like 70% reductions in fatalities, bizarrely enough, generally compare the rate of fatalities for car seats vs completely unrestrained kids. When you compare the rate of fatalities in car seats to kids wearing adult seat belts, the bulk of the evidence suggests essentially no difference. Fatalities happen when the forces involved are catastrophic and sadly a car seat doesn't help much for kids over 2.
Even a back of the envelope comparison makes this extremely plausible: car crash fatalities for kids 9-12 have declined by 72% from 1978-2017. If car seats and car seat laws save significant numbers of lives, you'd expect that the fatality rate for kids 0-8, who are generally in car seats, to have decreased much more. But it hasn't, it declined by 73% over the same period.
Now, car seats and boosters do seem to moderately reduce non-fatal injuries - huge spread of estimates here, most clustering around 10-25%. It's reasonable for most people to use car seats or boosters most of the time based on this alone, IMO, especially for young kids. But do they justify a mandate? IMO: no. Absolutely not.
Worth mentioning that mandates probably do succeed in one thing: they reduce the number of children born at all by at least 57x more than they prevent child fatalities. Roughly 8,000 kids per year, 145,000 kids since 1980. That's with the (unlikely, as discussed above) assumption that car seats do in fact save significant numbers of lives. But it's also entirely possible that they've prevented hundreds of thousands of kids from being born, somewhat reduced the nonfatal injury rate, and saved essentially no lives.
Citations below:
Fatality reduction with car seats or boosters:
- https://pricetheory.uchicago.edu/levitt/Papers/seatbelts.pdf (found that seat belts as effective as car seats for children 2-6)
- https://onlinelibrary.wiley.com/doi/10.1002/jae.2449 (independent replication of above with different data set)
- https://pubmed.ncbi.nlm.nih.gov/19959729/ (no statistically significant difference between booster seats and seat belt alone for fatalities)
- https://pubmed.ncbi.nlm.nih.gov/16754824/ (the main counter-estimate to the above, with the 28% fatality reduction)
Non-fatal injury reductions:
- https://ideas.repec.org/a/bla/ecinqu/v48y2010i3p521-536.html (no difference in serious injuries, ~25% reduction in least serious injury category)
- https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/... (14% reduction in likelihood of injury for boosters)
- https://pubmed.ncbi.nlm.nih.gov/19841126/ (45% estimate)
- https://pubmed.ncbi.nlm.nih.gov/12783914/ (59% estimate)
Reduction in birth rate from car seat mandates:
- https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3665046 (car seat mandates "led to a permanent reduction of approximately 8,000 births in the same year, and 145,000 fewer births since 1980, with 90% of this decline being since 2000")
Note that both the 45% and 59% estimate for injury reduction and the 28% estimate for fatality reduction all come from one research group using a proprietary data set. Everything that's independently reproducible points towards small or zero effect on fatalities and modest effects on injuries.
https://ourworldindata.org/child-mortality-in-the-past
We work less than our counterparts 150 years ago:
https://ourworldindata.org/working-more-than-ever
Air pollution has decreased over the past few decades (probably much further, just don't have data).
https://ourworldindata.org/grapher/emissions-of-air-pollutan...
We're obviously richer, too. Your grandparents had a cozy house - did they have good fresh food all winter when growing up? Could they keep food from going bad in the summer? What about indoor plumbing? These things are so ubiquitous now it's hard to even remember that they aren't just part of the basic fabric of reality.
It's easy to look back with nostalgia (and literal survivor bias - "my ancestors all survived") at the past. But if you actually look at history you will see that "what people have had for millenia" was ... pretty awful. It's an AMAZING time to be alive.
Then the government comes to me and says "hey, actually, turns out we need 500,000 forks and 300,000 knives and only 200,000 spoons."
I say "no, we are a spoon company. Very passionate about spoons. Producing forks and knives would be an entirely different business, and our contract was for spoons."
The military now threatens to destroy my company unless I give them forks and knives instead of spoons.
You say "the voters and congress tell the military how to use utensils, not SpoonCo. Shifting the decision to SpoonCo takes power away from the citizenship."
The military can sign contracts if they wish! They can decline to sign contracts if they wish!
But private citizens can also choose whether to sign or not sign contracts with the military. Threatening to destroy their business if they don't sign contracts the military likes (or to renegotiate existing contracts in the military's favor) is a huge violation.
Before I would just throw prompts at the LLM and it'd end up building a pile of crap (but semi-working crap, and 100x faster than I ever could) - it was pretty depressing. Using tools like `grill-me` (or `grill-with-docs`) I feel like I'm actually building my understanding of the system and helping shape it, and the results are much better.