Recent submissions

Comment · 5 months ago
Comment · 5 months ago
Interesting that the 3.5 Flash launches before 3.5 Pro. Historically it's been the reverse for Gemini since Flash is distilled from Pro?

Are they just training it a bit longer until it tops benchmarks?

Comment · 10 months ago
This is cool. I'm observing a trend of "build a tiny version from the ground-up to understand it" a la Karpathy's micrograd/minGPT. Seems like one of the best ways to learn.
Comment · 10 months ago
I switched to a new x86 machine. Running Linux on Mac just made things unnecessarily complicated and hurt performance. Im still open to using docker on Mac to run Linux containers but once you want a GUI life was simpler when I switched off.
Comment · 10 months ago
I don't have an x86 laptop at the moment so sticking with Macbook for now. My assumption is Mac laptops still are far superior given M-series chips and OS that are tuned for battery efficiency. Would love to find out this is no longer the case.
Comment · 10 months ago
I switched my desktop from macOS (10+ years) to Ubuntu 25 last year and I'm not going back. The latest release includes a Gnome update which fixed some remaining annoyances with high res monitors.

I'd say it pretty much "just works" except less popular apps are a bit more work to install. On occasion you have to compile apps from source, but it's usually relatively straightforward and on the upside you get the latest version :)

For anyone who is a developer professionally I'd say the pros outweigh the cons at this point for your work machine.

Comment · 11 months ago
Arxiv should just retire "is all you need" in the title. Block the post and make them come up with something new. Anything.

Same for YOLO "versioned" models. People just claim they come up with "YOLO-v15" as if it was their trademark to version.

Luckily "web3" burned the idea of branding some technology as a version of the entire internet...

Comment · 11 months ago
I don't know if you can generally say that "LLM training is faster on TPUs vs GPUs". There is variance among LLM architectures, TPU cluster sizes, GPU cluster sizes...

They are both designed to do massively parallel operations. TPUs are just a bit more specific to matrix multiply+adds while GPUs are more generic.

Comment · 1 year ago
Comment · 1 year ago
I would expect nearly every active AI engineer who trained models in the pre-LLM era to be up to speed on the transformer-based papers and techniques. Most people don't study AI and then decide "I don't like learning" when the biggest AI breakthroughs and ridiculous pay packages all start happening.
Comment · 1 year ago
I don't expect the majority of tech companies to want to run their own physical data centers. I do expect them to shift to more bare-metal offerings.

If I'm a mid to large size company built on DynamoDB, I'd be questioning if it's really worth the risk given this 12+ hour outage.

I'd rather build upon open source tooling on bare metal instances and control my own destiny, than hope that Amazon doesn't break things as they scale to serve a database to host the entire internet.

For big companies, it's probably a cost savings too.

Comment · 1 year ago
I'm trying to make a DIY security camera that can run local models, and stream video over wifi.

The TI SDK makes it easy to run demos but making any custom apps quickly gets complicated unless you are familiar with embedded Linux dev, Yocto, etc. Certainly much more complex than iOS/Android.

Hopefully over time the tools for embedded can catch up to mobile.

Comment · 1 year ago
Comment · 1 year ago
There's a swarm on HN that upvotes anything uv related and downvotes anything questioning it's added value as compared to pip

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton