fbergen

EU should focus on making an attractive startup market and more European LLMs (and so many other things) will emerge

Cool, makes you wonder how many more of these oneliners are scattered across the codebase (in application and also OS etc).

Sidenote, I wonder how close we are to detect these automatically. From profiling many various applications, it feels like that should be a tractable problem.

Thanks for the reply

I see, thanks for adding colour here I can see the benefits of a guaranteed immutable and permanent profiling data!

Indeed even seemingly non complicated things do have a lot of devils in a lot of details :)

Kudos of getting this out

Shouldn't "long term snapshot for profiling and inverting call stacks" be table stakes by now?

I'm more curious on how much manual effort was required to find said line of code? Strikes me as moest of these optimizations are super easy to verify, very difficult to find

What part of the stack takes the majority of the time for spawning a new replica? Is it the time to boot a VM/environment or is it application doing bunch of init work setting up connections etc?

Looks great!

Would this work for hosting databases too? I found the biggest annoyance and expense on my "infrequently accessed" side projects are databases, which are almost always idle.

Yet still people are using it?

Otherwise it’s called an MVP and a promise of plugging the holes

But you still have clusters, why not everywhere… ?

Am I asking too much? =P

I would love to have what we were sold as a “truly” serverless (even though the name doesn’t mean no server)

- CloudRun did a good job, but the autoscaling is too slow to not pay for idle

- Lambda is great, but I want to run way more complex workloads than simple functions

If they were only building them in volume

True, it doesn't mean that the problem is solved, but it's a big milestone on the way. I fwiw something I thought was way further in the future