jpgvm

Joined 13 years ago

Karma
9,990
Submissions
2,308
Member since
Mar 14
web: jpg.dev email: [email protected] twitter: @jpgvm github: josephglanville

Principal Software Engineer @ NVIDIA

Opinions are mine and not that of my employer, etc.

View on Hacker News

Recent submissions

Comment · 5 hours ago
Norwegians are honorary Australians apparently, we love a good shithouse.
Comment · 19 days ago
Pretty much everywhere has proved that ensuring people have a place to shelter and eat doesn't stop them from wanting to do something with their lives. It's the oldest and most wrong talking point from this debate.
Comment · 24 days ago
I was going to argue but:

> That code runs against a register file and a model of the PSP's memory.

From the project README. That to me, is an emulator.

Comment · 25 days ago
The walk is usually work too, just instead of staring at the screen and trying to think I take a walk and actually think. So when I get back I can provide input to the robot that will result in meaningful output.

Companies that pay people to hit enter instead of using auto-approve/bypass are going to lose to companies that pay people to think and produce results, regardless of how much time they spend in front of the screen or how many prompts they input.

Comment · 25 days ago
It's generally also just less typing if you are using long running agents, you can input the goals, steer it a bit then go for a nice walk and check in again on it in 30-40mins. I hope we can normalise this workflow as it will be much better for everyones health and longevity in the field.

IMO LLMs are the best thing to happen to coding in my ~15 years of being in the game.

I wager they have probably added on another 5-10 years to my engineering career as I was contemplating getting out before they showed up.

Have also been convincing some friends that have "gone woods" over the years to put the woodworking tools down for a day or two and give them a go. So far so good, a few folks have found the spark again and it's been awesome to see them make digital things again too.

Comment · 1 month ago
Honestly that just makes GLM the better model, sorry.
Comment · 1 month ago
What are they censoring that matters to programmers?
Comment · 1 month ago
Honestly Rails being finished it's that bad. If you aren't writing the code by hand what benefit is it really bringing to you now?

Rails niche was fast setup/low starting out costs and relatively constrained/medium maintenance costs. To get this you traded performance and type system. The latter usually resulted in increased maintenance costs as test suites ballooned to compensate.

These days fast setup is simply a product of AI, every ecosystem now offers fast setup. Maintenance costs are now about how token efficient it is to find and fix problems. Test suites are going to be huge everywhere now but there is some chance languages that require less to accomplish more will win on token efficiency and be favored.

Humans aren't the dominant factor in programming language design or selection anymore, that is a fact at this point it just hasn't sunk in for everyone yet.

We are only ~6mo in to agents being good enough to write code. A year from now our profession will be entirely changed. Agents will get better (how much? don't know) but importantly they will definitely get cheaper and access will be broader. Which is really the point DHH was trying to make.

Access and economics are finally going to do what no-code failed to do, which is democratise software. Maybe not to the point that everyone writes code or even that shit programmers are good, but it will enable shit programmers to write Rust which was literally impossible 6mo ago and they will have better programs as a result.

Which is the other thing he touched on. Good programmers are going to excel here and great programmers are going to dominate. I'm already seeing the 10x programmers hit 100x and 1000x with more access doesn't seem out of sight. It's also restoring the will to create in a lot of people that lost the passion for the mechanical part of programming, unlocking the experience and skill of these people that were otherwise considering cashing in the bag is huge.

So yes. Rails is done but what is coming next is way more exciting. I'm with DHH here, be glad it happened but get moving on where things are going to be instead of clinging to the past.

Comment · 1 month ago
I hope it's called Mar Sara.
Comment · 1 month ago
The important thing here is they have a bonding method working for stacking DRAM with logic and apparently also solved the thermals well enough too.

Logic is usually rated to run up to 110*C but DRAM processes aren't rated for such high temperatures and perform worse the hotter they get in terms of retention etc.

There are also some novel approaches here in terms of banking choices and impact on refresh times as a result.

The end result that matters for normies is that if this process is turns out to be a success it will challenge and perhaps beat HBM.

That in turn matters because this process is vastly more wafer efficient than HBM for the same bandwidth. Which in theory would ease supply on DRAM wafers.

Except it is also more efficient in terms of energy/bit/s so very likely what will happen is chips will still target the same TDP and just use even more of this rather than consume less wafers because that is just how AI is today.

Disclaimer: I work for a competing company that also makes AI inference chips.

Comment · 1 month ago
Probably the biggest/most interesting of the annual semiconductor conferences, held in August each year at Stanford.
Comment · 1 month ago
Depends on how well they translate that effort into promotions or company switches into better positions.

I averaged around 18mo to either a promotion or a move in my 20s, mostly off the back of working harder (to get the promotions/comp increases) and working smarter (to work out when they aren't coming and jumping somewhere else).

If this makes sense for someone has a lot more to do with their ambition/desire and ability to work the system than anything else. It also helps a ton if you are also legitimately very good at what you do. Then it's pretty easy because you are just demanding you are paid commensurate with impact.

Simply doing overtime and having hustle doesn't cut it though, you actually need to be able to leverage it into career progress or it's just wasted life.

Comment · 1 month ago
Comment · 1 month ago
I actually happen to know a lot about this! I have been in and around datacenters for ~16yrs and I work on direct liquid cooled hardware at $DAY_JOB.

Back when I was running my own startup I moved to Mascot, Sydney to be near Equinix SY3 that was being built which we had bought a decent chunk of committed capacity in. Mascot was originally an industrial area but was gentrified a lot over the last 20ish years but the datacenters, meat packers etc are all still there. It really adds to the charm of the place in a lot of ways, warehouses/factories that have been converted to cafes and breweries. Which is to say I don't think living near a DC is bad at all, they aren't very loud and they just look like big warehouses with lots of lights, cameras and no windows. Oh and security dudes.

Anyways. Yes. The hardware I am working at $DAY_JOB is all direct liquid cooled. The coolant that actually cools the hardware is closed loop, it's not expended. Which means you don't actually use any of it and it's considered good for the entire life of the hardware.

I normally don't directly talk about $DAY_JOB things because there are pretty strict rules so I can only use publically referenced sources but you can read a little bit about the coolant we use in this article [1].

The facility loop though is usually what people are worried about. A lot of datacentres that were built in low humidity environments use evaporative cooling which does indeed use a ton of water. However most data centers in more humid environments don't and either use loops that recycle the water but dump the heat (i.e rivers/lakes) or use closed loop systems with radiators etc. It's worth mentioning though that evaporative cooling is extremely power efficient vs most closed loop solutions so there is a tradeoff here. I don't think Google could achieve their fleetwide PUE (Power Usage Efficiency, basically measurement of how much power goes to things in a DC that isn't a computer) numbers without relying on it heavily.

Given the difficulties getting DCs approved in much of the world right now and the backlog on generation capacity (i.e power) almost all modern DCs are being built to use as little water as possible.

To give you an idea I think evaporative cooling of the type you would find in a state of the art Google DC with a PUE of ~1.1ish might use 1-1.1L of water for every kWh of actual equipment load (this is a back of the napkin estimate, don't hold me to it).

Conversely true closed loop will use approximately zero.

So yeah, evaporative is a big waster of water especially at GW scale.

1: https://www.tomshardware.com/tech-industry/data-centers/nvid...

Comment · 1 month ago
NIMBYs are the enemy of all that is good in the world.

No datacenters isn't about AI or even resources like water or power, it's mostly about real-estate and housing prices as usual.

If we listened to NIMBYs we would have no new infrastructure, no high density housing, no public transport.... oh wait.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton