tedivm
Joined 17 years ago
Joined 17 years ago
Come on Apple, do better.
* With jev-sec-bench the confidence numbers reached roughly the same as Qwen2.5-7b-instruct (confidence was off by about 6% on average in both cases).
* On the OpenRouter Banking 77 benchmark Jev did the worst out of all the models, being about 25 points off from reality.
I also think the fact that Jev hasn't published any real papers or actual technical details should make people a bit more skeptical than they have been.
https://www.propublica.org/article/draftkings-sports-gamblin...
This is something I've seen happen a lot with Google- their employees (especially the director+ folks) are absolutely rabid on social media when it comes to defending their products, and they don't let little things like "facts" get in the way.
Google needs to get a better social media policy because they look like clowns when they do this.
I'm a bit disappointed that they didn't call out how much bullshit was in that statement. They are just changing the default settings for new customers. That's it. All the deployed cameras remain the same, and new customers can just toggle those settings off of the defaults. It is so obvious that they were attempting to get credit for doing nothing, and reporters should call that out.
Book: https://www.manning.com/books/terraform-in-depth
Portfolio: https://projects.tedivm.com/
Github: https://github.com/tedivm
BlueSky: https://bsky.app/profile/tedivm.com
Fediverse: https://hachyderm.io/@tedivm
LinkedIn: http://www.linkedin.com/in/roberthafner
Comments are my own and not those of my employer.