ianand

Would be curious if https://spreadsheets-are-all-you-need.ai/gpt2/ works on your Chromebook. You need to download the weights and then drag and drop them back into the page but maximum compatibility was one of the design goals.

Comment · 1 month ago

Interestingly, I find absolute positional embeddings easier to explain to a layperson than rope, e.g. [1]. What am I missing?

[1] https://www.youtube.com/watch?v=ZuiJjkbX0Og&t=5712s

Comment · 5 months ago

In that case I humbly suggest my talk from AI Engineer World's Fair https://www.youtube.com/watch?v=ZuiJjkbX0Og

Gives you the basics on LLM internals in about 90 minutes and includes an already built model in JavaScript that you can step through in browser devtools to get as detailed as you want.

Comment · 6 months ago

It's like "GPT is all you need for the backend" [1] on steroids

[1] https://news.ycombinator.com/item?id=34503418

Comment · 9 months ago

Since you mention serverless it might be worth mentioning firecracker and v8 isolates.

Comment · 9 months ago

I'm not a fan of the database lookup analogy either.

The analogy I prefer when teaching attention is celestial mechanics. Tokens are like planets in (latent) space. The attention mechanism is like a kind of "gravity" where each token is influencing each other, pushing and pulling each other around in (latent) space to refine their meaning. But instead of "distance" and "mass", this gravity is proportional to semantic inter-relatedness and instead of physical space this is occurring in a latent space.

https://www.youtube.com/watch?v=ZuiJjkbX0Og&t=3569s

Comment · 1 year ago

The site’s domain name is the best use of a .fail tld ever.

Comment · 1 year ago

Lol. You joke but... https://www.reddit.com/r/GraphicsProgramming/comments/pg9dw8...

Comment · 1 year ago

Dude, been forever. Thanks. Will DM you.

ianand

Recent submissions

Reed Hastings says Big Tech should get used to being hated – like Big Pharma b businessinsider.com

An economy for open weight AI models t twitter.com

Stanford Study: Give up AI for a month for $500? d digitaleconomy.stanford.edu

Cognitive Mercantilism: AI panic resembles fears of early capitalism c contraptions.venkateshrao.com

Reed Hastings says Big Tech should get used to being hated – like Big Pharma businessinsider.com

An economy for open weight AI models twitter.com

Stanford Study: Give up AI for a month for $500? digitaleconomy.stanford.edu

Cognitive Mercantilism: AI panic resembles fears of early capitalism contraptions.venkateshrao.com