andy12_
Joined 2 years ago
Joined 2 years ago
By the way, don't act as if the Japanese high speed network is not the best on the planet. It's much more liberalized than the Spanish one.
The rail infrastructure is already publicly maintained via a government agency, ADIF. ADIF is not a goverment-owned for-profit corporation, its primary mandate is public service, not profit maximization, and ADIF doesn't compete with anyone, it's a state monopoly.
> "Due to a system malfunction, the elevator will be out of service longer than usual," the public address system announces. The minister laments, "Oh, for heaven's sake. As if we didn't have enough to deal with already with Renfe."
Very funny minister...
[1] https://www.lasexta.com/programas/cara-show-marc-giro/oscar-...
- It conveys the idea that they aren't tokens normally visible or part of the final answer.
- It conveys the idea that the longer the models "reasons", the better the output.
What other term best describes both of these ideas? Why should we use a less useful terms just because it can confuse some people? I mean, some in 1952 feared that calling computer memory "memory" was already too much anthropomorphization[1]!
Note that I don't think OpenAI is incapable of doing it, but I just don't think they will bother with it.
> My main assumption is that Jev is using something quite close to a conventional large language model. As evidence of this, Latent Space reports that many of the early clones are indeed LLM-based.
Not proof that this is the case with Jev though. It might use non causal text encoder for the state, which could make sense given that it's very good for its price.
softmax(encode(input)*learned_weights)
You have
softmax(encode(input)*encode(categories))
I'm not sure if Jev does it this way, but it's how you get open-vocabulary zero-shot image classification with models like CLIP [1].
I have tried many of these open-source Jev-like models on some linguistic tasks and they are so bad compared to Jev.