smsx

The 4.8 model costs the same as it's 4.7 predecessor.

Are the numbers in the H100 PCIE vs SXM table swapped for rows 3 onwards? It looks to me like the PCI is showing higher GiB/s numbers, which is counter to expectations. Or am I misunderstanding those benchmarks?

I don't think first class Linear or Notion support will be high on their list given who acquired them.

it's being actively worked on!

The numbers are pretty incredible. Will the competition be able to match them?

Wow, incredibly fast. Can easily replace my Groq usage if they can keep up with capacity demands.

Yup, check out Rho-1 by microsoft research.

Sounded like he he was talking about a public blog post right?

The point of this post isn’t the linear transformer algorithm. They’re surveying a variety of Linear transformers and showing a general form in order to talk at large about their performance characteristics.

They didn't say they joined 11 years ago, but that they were 11 years into their career.

Why does this sound like ChatGPT?

Actually, in the last few months there has been an absolute ton of feature work. A very sophisticated generational profile system was introduced, and the entire framework is being split into separate packages to enable more stable versioning. This is all with the goal of reducing the bus-factor from being just Henrik.