rufasterisco
Joined 10 years ago
Joined 10 years ago
Looks like your great question doesn’t have an answer, but looking at the routing strategies things get even more confused, since the proposed ones tend to rely on extra llm calls to determine which model to pick.
The nice thing is that it makes sense for specific setups, less conversation oriented.
As an example, you need to classify batches of data, and have many fine tuned models. Or you need to do speed to text and need to pick which whisper to use.
You can write your own strategy, in that case an harness with subagents would be able to leverage this, picking the right model and then keeping its session sticky, but overall the lack of concern for caching points towards use cases where you do not gain much from it.
Also try fine-tuning small models and see how they perform.
I’m not saying Meta is not eager to syphon data from users, but I don’t see how this happens via this specific product.
There are many reasons for critizing him over things he is responsible for.
Never been a fan of mob lynching.
They could have written “ Island’s government says no denial given…” and it would have been equally true.
for example in gaming context, if you need an answer below 5 seconds, they are the sweet spot
Overall, openAI can sit on a mountain of money and bet mobile phones are the final form factor for human/AI interaction, as they have been for human/internet.
Or deploy some of that money and figure out whether that is true.
It’s also about creating an environment for those features to emerge, without being constrained by someone else platform, that could natively embed it at any time, and (probably more important) app marketplaces.
A signal for opportunity is also given by Apple’s inability to give their users Siri and Google sitting on transformers while OpenAI grabs the chatbot marketplace.
Also, anything they build does not cannibalize their other product lines.
There are lots of incentives for them to try out and figure out features on the fly, which arguably also happened with the IPhone (app store).
This has emotional/psychological aspects (it feels less like LLMs are replacing you), as well as practical ones (overall complexity is bounded by what the dev brain can understand/grasp).
A dev work becomes more and more about reliability, signing off safe software with a litmus test: “I will be on to handle this code failure as if I had written it”.
All the above points towards keeping tight control over some level of abstractions and delegating others.
The essay from Zuckerberg
I am assuming the reason companies switch to them is not price or tech. US cloud providers have the advantage on both.
Selling EU companies data would mean destroying trust over their main selling point, not to mention incur on EU wrath.
Feels like living one whistleblower away from doom.
I refer to fully EU clouds, parent list includes US clouds that do not need bags of money, Clouds Act in enough.
Hold on.
I accept all the rethorical apocalyptic stuff, it comes with the title and each of us can have an opinion.
But “move fast and break things” is Facebook motto, and when it come to sociability, society at large, and politics, I you cannot say that.
Facebook/Meta merely breaking B2B SaaS?
It’s not really about “Meta is bad”. It’s recognising the fact that social media, spearheaded by Facebook has changed society and politics.
Some like it some don’t. I don’t want to enter a culture war, but can we agree that with Meta the “object in question” is not just a SaaS? It is sociability, it is society, it is politics?
This guy is an associate professor of politics at Princeton University.
How can you advocate for future policies over AI while at the same time misleading on the tech revolution that has shaped the past, what, 20 years?
What is being taught in those classrooms?
They run kimi3 on an “unsecured” sandbox, which had access to GitHub.
Kimi somehow knows the repo. It clones it. It finds the solution.
The hack? Using git?
https://blog.frontier.security/chinese-model-kimi-k3-breaks-...