textlapse

Say what you will about Sam Altman, but at least he engages with his user base and acts on user feedback.

Dario and co seem to be on some elevated pedestal - us mere mortals are beneath them - and they have this scattershot devrel where each engineer has their own X way of communicating to the public often at odds with each other.

I loved Sonnet and Opus fwiw but not anymore.

At what stage does a series of floating point numbers output from a GPU become conscious?

Does anyone here know if this would potentially help people with adult SNHL (not genetic)? i.e. for folks who got SNHL when they were >= 25 years old?

Thank you.

If someone could please give an octopus a waterproof keyboard, perhaps we could have a kernel, a compiler and a new internet protocol all in one.

To really confuse it, ask it to take that tricycle with the platypus on it to a car wash.

It's definitely possible, I am not arguing against that.

I am just saying it's not as flexible/cost-free as you would on a 'normal' von Neumann-style CPU.

I would love to see Rust-based code that obviates the need to write CUDA kernels (including compiling to different architectures). It feels icky to use/introduce things like async/await in the context of a GPU programming model which is very different from a traditional Rust programming model.

You still have to worry about different architectures and the streaming nature at the end of the day.

I am very interested in this topic, so I am curious to learn how the latest GPUs help manage this divergence problem.

warp is expensive - essentially it's running a 'don't run code' to maintain SIMT.

GPUs are still not practically-Turing-complete in the sense that there are strict restrictions on loops/goto/IO/waiting (there are a bunch of band-aids to make it pretend it's not a functional programming model).

So I am not sure retrofitting a Ferrari to cosplay an Amazon delivery van is useful other than for tech showcase?

Good tech showcase though :)

What's the performance like? What would the benefits be of converting a streaming multiprocessor programming model to this?

I would love to see a nutritional facts label on how many prompts / % of code / ratio of human involvement needed to use the models to develop their latest models for the various parts of their systems.

There is a big difference between paperbacks and TikTokification:

Paperbacks required authors to spend the same amount of time/effort to create content with a vastly expanded market and distribution mechanism.

TikTok and Insta created N creators to M consumers where N is nearly the same as M. Making the distribution channels bigger but effortless to create content doesn’t magically equate quality paperbacks with short form hummingbird-attention videos.