ma2rten

Erm, ... OpenAI has hyped when it started and it took 6 years to take off. It's way to early to declare the SSI and Thinking Machines have failed.

Delaying doesn't necessarily mean they stop working on it. Also it might be a question of compute resource allocation as well.

You can add Show HN to the title for your own projects. They will show up in the show tab.

Europe is quite conservative, in the sense that they would not invest billions into an unproven venture. It makes sense that it would excel at an industry that requires putting safety above everything.

It's actually true on many levels, if you think about is needed for generating syntactically and grammatically correct sentences, coherent text and working code.

Interpretability research has found that Autoregressive LLMs also plan ahead what they are going to say.

Your use of the phrase makes no sense. It's the "no parking" that proofs the rule and not the exception.

You can also look at the price of opensource models on openrouter, which are a fraction of the cost of closed source models. This is a market that is heavily commoditized, so I would expect it reflect the true cost with a small margin.

Presumably the model is trained in post-training to produce a response to a prompt, but not to reproduce the prompt itself. So if you prompt it with an empty prompt it's going to be out of distribution.

The study seemed not very convincing to me, at least the way it was described in the article. To summarize: they asked crowdworkers to write a law who used legalese, but not when writing news stories about it or when explaining the law. From that the researchers concluded that people use legalese to convey authority.

But what if people just imitated the writing style of existing laws, but not with the intention to make it authoritative but because that is what they understood their task to be?

This is the same problem as echo cancellation on calls. This is something that built into a lot of software and hardware.

t5x was used to train PaLM 1.

Apples cares about the privacy and security of iPhones as a differentiator.