> One common failure mode? Treating data that was known to be of poor quality as if it was reliable because good data was not available… they also use the poor quality data to assess the resulting models.
This drives me nuts. Spend $10k getting high quality data and throw a simple model at it? Nah, let’s spend a month of time from someone making $400k/yr for less trustworthy results. And on the blogosphere it’s even worse. ‘This is the best data available so here goes’ justifies so much worse-than-worthless BS.
And don’t even get me started on the ‘better than human’ headlines that result.
This drives me nuts. Spend $10k getting high quality data and throw a simple model at it? Nah, let’s spend a month of time from someone making $400k/yr for less trustworthy results. And on the blogosphere it’s even worse. ‘This is the best data available so here goes’ justifies so much worse-than-worthless BS.
And don’t even get me started on the ‘better than human’ headlines that result.