brandensilva

The cycle's will never gonna end. It's just gonna be incredibly faster now.

Yeah, I'm more interested in them covering the majority of people's needs and use cases than I guess having a hundred percent compatibility with libraries I'll never use.

I'd much rather it be a focus that I could run bun in serverless, sandbox, wasm, or workerd-like environments for agentic workflows where bun is the runtime to power additional functionality for AI agents.

I assume this is why Anthropic purchased them beyond just a PR stunt and where the project is going.

If it was one memory leak, it would be meh in the fix list, but the fact they've announced that they've eliminated all memory leaks because of Rust in about eleven days that's what's wild to me.

We are living in a new world when it comes in how software is prompted into existence.

Elixir started adding a type system as well after Typescript proved to greatly help AI feel confident in its output.

So yeah others are catching on the importance of a type system to enforce that successful contract for AI agents.

But there will be and his point is they cut off supply to make room for the new M5 ultra which I hope has 768GB or more of memory.

So reckless but needed.

It's easy to see why people fear AI when our leaders talk of a future where many are jobless and replaced with no solutions to fill in the gaps.

AI adoption is a leadership failure more than a tech one right now. If you make people feel empowered with it, it can liberate work-free lives that humanity benefits from. If you use it to destroy people's livelihoods with no options it's not going to survive a revolution.

The irony here is the red Republican states are the ones voting for this who will be most impacted by it.

Thoughts on a M5 Ultra 768GB if it drops? What's the price to make it worth it for you over a spark cluster?

I'm wanting to run Kimi 2.6/2.7 GGUF on it and just slap it in the server rack, but trying to decide if a spark cluster makes more sense.

This is correct, they are subsidized but it's the training cost that costs the most with a majority of people hitting cache for most queries for inference.

Devs are hard to market and sell too I've heard. It's likely because they can build a lot of the stuff out there themselves when pressed. They have the most app exposure so are opinionated. It's why most devs take the open source spoils while everyone else avoids GitHub in general. Although AI has made it easy to setup locally, many still don't see the value of controlling their software or ai agents fully like devs.

Yeah the cost doesn't justify the value. Spending x3 on tokens is meaningless if they aren't seeing the profit side scale with it. Going faster on product features doesn't mean it translates to more money. In fact I'm not even sure some customers can handle the speed at which a team could move with feature delivery.

So scaling horizontally in different markets seems like an advantage if a product is already mature. Which is exactly what Anthropic and Open AI are doing because they want to put their tentacles in everything.

That's exactly what I'm doing. Push for model flexibility, cost control, and reliability.

The moat is to be anti lock in. The open source model needs to be amped up on steroids to avoid this permiating every facet of your org you cannot escape.

Exactly, it's far bigger than Meta when the government's are pushing a larger agenda here.

The assumption is you have to control people to enforce laws. They keep pushing this notion that is a requirement to keep people safe. That somehow if we have big brother AI surveillance everyone will be on their best behavior.

Oracle, Palantir, Meta, and other mega billionaires push this agenda because who is going to stop them from controlling society and getting absurdly powerful and wealthy from it?