david-gpu

Joined 10 years ago

Karma
5,937
Submissions
1,702
Member since
Aug 27
Retired GPU architect.

Wishing you could block some HN users? (Perhaps me!)

Try Martin Tournoij's script: https://gist.github.com/arp242/3159b9cbbbe148c786e1ca10adaaea61

View on Hacker News

Recent submissions

Comment · 1 day ago
I wish more billionaires kept their opinions to themselves, rather than trying to influence everybody.
Comment · 2 days ago
According to the available information, the failure of the automated system caused six trains to stop. They were then given manually the go-ahead to proceed at full speed (!!!). Six does not sound like a huge number of them to ensure that the train ahead is moving normally before the train behind is told to continue. This sounds like a massive failure in either the protocol or the operator's ability to follow the protocol. Mind boggling stuff, really.

As a Spaniard I am profoundly ashamed that these crashes are happening, when other countries like China, France and Japan seem to manage just fine with their extensive high-speed rail networks.

Comment · 3 days ago
Clearly! I was a happy customer, but that decision made me go through the effort of setting up a pay-as-you-go inference service with open-weight models, which I didn't want to bother learning how to do. But now I am perfectly happy with them and lost any interest in Gemini.

I bet I am not alone, either.

Comment · 3 days ago
I have a yearly plus subscription and I am still seeing 3.6. I am not renewing it once it expires. Why not give subscribers a small usage quota of their latest flash models?
Comment · 3 days ago
I paid for their lowest-cost subscription, thinking that it would give me a small quota of use of their most recent flash models. Instead, they give me an unnecessarily large quota of their old models, which I have precisely zero use for given that open-weight models are better and cost next to nothing.

Consequently, I have zero intention of renewing my Gemini subscription. What a dumb business choice they made.

Comment · 3 days ago
> Most people here probably have around $5-10M in assets given we’re mostly in tech.

You would be surprised. Not only because, as you point out, recent graduates often have a negative net worth, but also because people tend to increase their spending in lockstep with their income.

Saving millions takes the intersection of multiple factors: sufficient disposable income, prioritizing investing over lifestyle, long-term discipline to stick to the plan, and luck to keep it all going smoothly.

Comment · 3 days ago
From the article in El País:

> “A human error by an [state-owned railway infrastructure company] Adif operator in response to a malfunction in the main signaling system is the likely cause of the accident,” government sources said. This safety system is automated, but when it fails, it switches to manual mode. That is why the trains came to a stop when the automatic safety system failed, and service resumed under human control — and that is where the error occurred, according to initial analyses.

This is not the first time something broadly like that happens. In 2013 another train crashed because there was a section of the track where the operator had to manually adjust the speed, and he didn't.

One would think that the operation of these trains would be fully automated at all times, and with sufficient allowances to handle emergencies safely.

Point in case: Japan has not had a single death due to a crash of a high speed train, even though they have been operating an extensive network for decades.

Comment · 3 days ago
> What you're describing is vaguely how video games work, to my understanding.

Your understanding is broadly correct. There is a 3D world, and the GPU computes how it looks like from a particular viewpoint.

In essence, objects are painted back to front, so that in the final image every pixel shows the nearest visible object. The details get complicated, but the idea is simple.

Comment · 3 days ago
It is possible that it is not hard, but they didn't have time to implement it for this release. It happens all the time in fast-moving industries.
Comment · 4 days ago
> Those hardwired fixed-function parts are getting fewer and less important though

There is more machinery internally than what the user can see. Even "low level" APIs hide quite a lot of the internal complexity.

> Also AFAIK something like a texture sampling operation is indeed a 'fancy instruction'(?)

Yes, and no. The "I want to sample this texture" part looks like a fancy instruction to the shader processor. But there is a fair amount of setup that needs to be done before and after, and that is the responsibility of the device driver. Stuff like: where is the data, how is it arranged in memory, how it is to be sampled, etc.

As you point out, the texture units are coprocessors inside the coprocessor that is the GPU itself. It is turtles all the way down. Think of a GPU as a whole network of processors inside a chip, some of which are hidden from the application programmer.

> I bet this type of GPU/CPU handshaking work could also be baked into the hardware (similar to CPU mirocode) and exposed via a standardized memory mapped IO interface (or whatever the current mechanism is for letting the CPU control the GPU)

Attempts have been made. Last time I checked, they had not been very successful, but I have not kept up with the latest developments after retirement.

The way this normally works is that there is a circular command buffer where the CPU inserts commands and the GPU consumes them. It works; there is nothing wrong with it. It is the obvious way to handle asynchronous coprocessors.

> E.g. a CPU also implements similar protocols to talk to the rest of the computer system (e.g. memory and other CPUs), but this is mainly implemented as "hardware protocols" - drivers "just" offer more flexibility for hardware vendors because they can delegate the standardization into software.

I suspect you underestimate the amount of setup that is necessary to drive a GPU. And the amount of asynchronous resource management involved.

Let me put it this other way: the people doing this for a living for decades know what they are doing. There have been attempts to try to make GPUs that behave more like CPUs in terms of how they are driven, and they have not been very successful so far, to my knowledge. AMD acquired ATI back in 2006, so it is not like there hasn't been enough time for the concept to cook in the oven. See also Intel's Larrabee.

Comment · 4 days ago
You underestimate the effect of two factors.

First, GPUs aren't simply "highly parallel CPUs", they also contain a whole lot of fixed function hardware that is specialized for real-time computer graphics. This hardware isn't exposed as "fancy instructions", it is set up in other ways, which is achieved through a device driver.

Second: GPUs are coprocessor, separate from the CPU where another OS is running. This also necessitates a device driver to manage scheduling, synchronization, etc. with the main OS. Because, in case you were not aware, the GPU itself runs its own little operating system, although it is rarely called that.

Comment · 7 days ago
Scars and scratches do tell stories, whether they are on our body or on our bikes. Sometimes the same event gives you scars and also leaves a mark on your bike.

Would I go as far as "appreciating their beauty"? More like accepting that they are there, let them remind us of what happened, and how we prevent something like that from happening again.

For some young folks it may be an opportunity to pause and think about how sometimes people do not recover from their injuries. Most of us eventually become disabled, and we still need to continue living our lives as best as we can with what we have, which is why public transit, walkability and accessibility are important to preserve.

Comment · 7 days ago

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton