NeutralCrane
Joined 7 years ago
Joined 7 years ago
The US is on the hook for its decisions. But Europe doesn’t get off the hook for its own.
Classifiers like classical NNs require:
- annotated data, potentially a lot of it - training - inference
#2 and #3 aren’t a big deal if you have an ML engineer, but #1 will always be a potential headache no matter who you are. The tradeoff is that they could be quite fast, cheap, and you can get probabilities, not just classes.
With LLMs you get:
- zero shot classification (no dataset or training required) - potentially can use third party model providers like OpenAI off the shelf. Don’t even need to host your own model.
The downside to LLMs is that they are comparatively slow and expensive to traditional classifiers. Historically they also were prone to hallucination or malformed responses, though not as much these days. You also can technically get log-probs back, but these aren’t equivalent to the classifier probabilities.
Jev gets you the zero-shot, zero-infra benefits of LLMs, while being closer to the speed and cost of traditional ML classifiers, as well as both classification and probability responses.
Early in my career I worked for a pharmaceutical giant as a statistician. One of the things we would work on was trying to determine how much the various advertising efforts the company did actually moved the needle. Every year was the same miserable experience. The company would spend millions and millions of dollars in various advertising channels. We would attempt to determine how effective it was, but the wayin which they advertised and the way we collected data made it very difficult to generate any kind of insight at all. We would make recommendations as to how to adjust execution moving forward to ensure we could reliably determine how much value we were getting out of these campaigns, all of which would be ignored. They would massage our findings to tell whatever story they needed and would do the same thing the next year.
The marketing division is its own organization, with their own incentives that don’t necessarily align with the broader company’s incentives. They also were heavily addicted to relying on external analytical consultants who could pump out all the slide decks and pie charts they wanted, which would inevitably show that the marketing was not only effective, but should be invested in more the following year.
For what it’s worth, as an American, I agree with them. The USA is proving to be unreliable, if not outright malicious, to our long term allies.
I don’t think truth aligns with either extreme. Both are approaches that have their place. But if it was an “uncreative” with no ideas that simply took the time to look and discovered that the three point shot was absurdly more efficient than basically any other shot in basketball, what does that say about all the “creative” coaching geniuses who failed to discover it in half a century? And if basketball is now “less creative” because of it, that’s an indictment of the fact that the league refuses to address the underlying issue.
I think it’s telling that no one bemoans the fact that we design our medicine using data driven methods. I’m sure it would spice up our lives if the pharma companies dropped the boring data analysis and statistical methods and just slapped some compounds together through free-flowing creative passion!
Both are based on pre-existing material but GoT source material predates the Walking Dead by 7 years.
I’m also not sure I understand the “ My place used pylint, flake8, black, ruff -- with hundreds of commits on every change”. These tools don’t add extra commits. You run them prior to your PR, get them aligned with the linting, and then commit the change you were already going to make. Thats 0 extra commits.
For someone ultimately arguing that there is too much effort spent on people’s coding styles, you are spending a lot of effort arguing about people’s coding styles. These tools are some of the most set it and forget it things around.