redcodenl

I am a developer.

And I'm surrounded by "vibe coders" and I'm starting to accept this new reality. Unburdened by knowledge and reading the code, they can produce output at an incredible pace.

But I can't be objective about vibed code...

However what I can do, vibe in a different field, mathematics.

I've made a visual walk through the machinery inside a large language model: from raw text, to tokens, to vectors, to attention, to the next token.

If you have any comments/questions/remarks/improvements, let me know!

That sounds like otter nonsense...

Last January a challenge was posted online by Gunnar Morling: How fast can you parse a file with one billion rows of weather data using Java? Little did I know this deceivingly simple question would lead me down a path that taught me all about: parallelism, memory mapped files, SWAR techniques (SIMD as a register), bit twiddling, branchless code, mechanical sympathy, Graal native compilation and finally... I even turned to the dark side: using sun.misc.Unsafe. Join me in this deep dive where I'll explain all the code changes and tricks that took me from the reference implementation which processes the billion records in less than 4 minutes, to processing everything in under two seconds. Who knew Java could be this fast?

These fully customizable developers are powered by the advanced GPT-4 model. Digital Developers™ offer a cost-effective alternative to traditional Java developers, with a host of exceptional capabilities.

Or: Why is Python still growing and Java falling behind?