Yeah, this is an issue with way more science than anyone (esp scientists) is comfortable acknowledging
In grad school I encountered experiment after experiment, paper after paper where the authors went around emphasizing the parts which were statistically “sexy” while ignoring glaring issues like this
It’s almost like the methodology for creating science is more rigorous than the science itself
Sometimes the sample is too small. Sometimes they assume a correlation that doesn’t exist. It’s troubling and was a large part of why I left academia
In grad school I encountered experiment after experiment, paper after paper where the authors went around emphasizing the parts which were statistically “sexy” while ignoring glaring issues like this
It’s almost like the methodology for creating science is more rigorous than the science itself
Sometimes the sample is too small. Sometimes they assume a correlation that doesn’t exist. It’s troubling and was a large part of why I left academia