throwaway427

This is a great presentation.

Where I work we don't use any process level parallelism at the ruby level, we hoist that up to the kubernetes level and use signals (CPU load, job queue sizes, etc) to increase/decrease capacity. Workloads (replica sets) are segmented across multiple dimensions (different types of API traffic, worker queues) and are tuned for memory, cpu and thread counts according to their needs. Some heavy IO workloads can exceed a single cpu ever so slightly because db adapter isn't bound by the GVL, but practically speaking a pod/ruby process can only utilize 1 CPU, regardless of thread count.

One downside of this approach though is it takes a long time for our app to boot and this along with time to provision new nodes can cause pod autoscalers to flap/overprovision if we don't periodically tune our workloads.

In a perfect world we would be able to spawn processes/pods that are already warmed up/preloaded (similar to forking, but at the k8s level and the processes are detached from the root process) in a way that's not constrained by the CPU capacity of some underlying k8s node it is running on and instead is basically an infinite pool of CPUs that we only pay for what we use. Obviously serverless sort of offers this kind of solution if you squint but it is not a good fit for our architecture.

Since you seem to have some insight into this, I interviewed a former Heroku eng a while back and he said that they deploy Heroku infra on Heroku, essentially dogfooding their own product. I also see a lot of claims that Heroku has essentially stagnated on features. I'm curious how do internal teams reconcile this (do they just work around the stagnation?) and is there a layer that is a choke point for product improvement that also affects to internal teams (if so that would seem demoralizing)?

Apollo has the ability to intercept clicks on reddit links and open them in the app. It works pretty well.

Hahha TRULY.

I loved reading the CDC growing up. That one of them is a serious presidential candidate now is truly making my day. I'm almost in tears laughing at the idea.

It's also possible that that software system isn't triggered the same way on AA and SWA 737s as it is on the other airlines...

You keep posting this Reddit comment in every single one of these threads. Maybe lay off for a bit?

I listened to this interview and it's interesting the way you put it:

Steve Inskeep rephrases a statement that Goelz makes to make it seem like the FAA is short staffed and that airline compliance is on the honor system.

Goelz then says what he means is that there cannot be an independent FAA inspector in every single corner of a manufacturer or maintenance shop, but by then it's too late because the seed has been planted listeners mind.

So here you are saying the "FAA and NTSB just doesn't have the resources to provide adequate inspections" and that the overall compliance model here is "cooperative self regulation" which... I guess barring the FAA having a 1:1 staff for every employee in the airline industry we are indeed going to have "cooperative self regulation".

I agree and I don't think you deserve the downvotes. The FAA is an institution with a deep sense of safety first and independence from (and even dominion over) private industry.

They are also a body of experts, with more collective knowledge than any other similar body of domain experts in world.

If we believe in institutions of experts who study and make recommendations regarding complex systems, we owe it to the FAA to trust they are charting a prudent course based on the evidence they are gathering and analysis they are doing.

thanks for the mansplain. you got new york figured out, bro.

Concur, lived in Texas and NYC both, Austin is hotter for sure, but air conditioning is on blast everywhere and the driving helps. Just walking a couple of blocks on a 90 degree day in NYC is enough to get you soaked.

On top of that you can wear shorts most workplaces in Austin and not have a problem. Shorts in NYC is frowned upon in the cosmopolitan set and professional industries.