jacobgorm

Joined 13 years ago

Karma
930
Submissions
345
Member since
Feb 23
CS PhD who invented live VM migration. In AI since 2016, founder at Vertigo.ai and Jamscape (exited to Dropbox)
View on Hacker News

Recent submissions

Comment · 5 days ago
Can you describe in detail what these powerful institutions are, and how they manage to hold back change?
Comment · 6 days ago
The model architecture might be ten old, but it seems it was trained recently, so the title is a bit misleading.
Comment · 9 days ago
Land of the free...
Comment · 11 days ago
It should come with a flight attendant and an obligatory five minute safety instruction before each ride. I've ridden in multiple Teslas, including many Ubers, and no one has even given me the manual to read or shown me how to escape in case of a fire.
Comment · 25 days ago
The register is hosted by US-owned DXC (formerly CSC.), who, apparently, did not know how to rate-limit the lookups.
Comment · 26 days ago
"A little plague will be good for your natural immunity, by my favorite Danish team of crackpot researchers have just received $10M in express funding to test in African children whether the GCB vaccine helps, when we expose them to the bacterium"
Comment · 1 month ago
Even this week following new mediocre PISA results for Danish pupils, I see organizations like the Danish Industry Association and the Danish Chamber of Commerce posting calls for more computers in classrooms, to combat the problems caused by computers in classrooms. They say kids just need to be tought better “technology understanding”.
Comment · 1 month ago
I prefer to wirelessly charge my phone because the charging port is the part that typically wears out before the rest of the phone. My first EV's charging cable also wore about after around seven years of use, so I had to replace the entire charger. Charging port doors on some EVs also also known to develop faults in the locking motor, and the ports and/or its cover tends to fall of, which is is costly to repair as you need to repaint the new part. And then come the issues with having to choose EV models to suit the layout of your garage, as well as issues with the cable getting in the way when trying to pass the charging car with your bike, etc.

I cannot afford the Cayenne, but once this gets to cheaper models this will be an option I would be willing to pay for.

Comment · 1 month ago
Comment · 1 month ago
I can program all my non-CUDA GPUs use completely open non-proprietary toolchains. And if that ceases to be the case on one platform I can switch platforms without having to rewrite all my code.
Comment · 1 month ago
If that business makes it money selling a cross-platform AI inference engine, as was the case for my previous startup, it is bad business to tie yourself to single platform. I managed to build a single code base that would support CPUs, OpenCL, Metal, CUDA, D3D12, and WebGPU from a single set of kernel sources. As a single developer, there was no way I would have been able to, at the time, maintain separate code paths and GPU kernels for each of those platform, in addition to training the models etc.
Comment · 1 month ago
It is currently faster than the stock Candle / MPS shaders it replaces on MacOS/ARM64, and IIRC a bit slower than OpenVINO/CPU on my old Windows laptop, where I never got OpenVINO/GPU to compute correctly. Candle didn't have support for GPUs on MacOS/Intel, and OpenVINO ceased to be supported there.

Compared to OpenVINO (I tried ONNX runtime too, but never got it produce correct outputs with my quantized models) it is very nice to be able to build the exact kernels I need, at the quantization settings and precision that works for the models I have and with the custom operators required (speech models do a lot of non-standard stuff), run from a single set of sources, and not have to ship a hefty third-party DLL, and having to deal with their memory leaks and other stability issues.

Comment · 1 month ago
As it happens, I just got my employer's permission to release as open source a Triton back-end for Metal and D3D12 GPUs here: https://github.com/dropbox/neso .

As an example of you how can use it to deploy real models there is this project doing ASR and TTS: https://github.com/dropbox/nspeech .

Finally, I am also going to be switching the inferencing part of Witchcraft from current Candle on MacOS and OpenVINO on Windows to just Candle with Neso; https://github.com/dropbox/witchcraft

Comment · 1 month ago
What reasons would you have to prefer Rust over C for compute kernels? I am a great fan of Rust, but I don't see any benefit for kernels, due to their relatively simple nature.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton