amanda99

Being battle tested is the only good thing I can say about LiteLLM.

I'm excited to see this. Have been using LiteLLM but it's honestly a huge mess once you peek under the hood, and it's being developed very iteratively and not very carefully. For example. for several months recently (haven't checked in ~a month though), their Ollama structured outputs were completely botched and just straight up broken. Docs are a hot mess, etc.

Look, I agree with you and as someone with Home Assistant, I much prefer Zigbee.

But if you imagine a typical consumer, not a tech nerd, I think "smartphone and bluetooth" is by far preferable to your 4-step process.

You would use a KV cache to cache a significant chunk of the inference work.

> If you want youtube (or any other platform) to not suck...pay for it.

If we are going for solutions where your individual decision makes no impact on the system in place, then let's go big: ditch youtube and host your content on one of the alternatives.

I really liked the first chapter: the juxtaposition between ideas on how "AI"/algorithms/etc work and how humans work. I enjoyed how it was flipped around.

The second chapter was very disappointing and lost the intrigue I had built from the first.

Does this not require one to trust the hardware? I'm not an expert in hardware root of trust, etc, but if Intel (or whatever chip maker) decides to just sign code that doesn't do what they say it does (coerced or otherwise) or someone finds a vuln; would that not defeat the whole purpose?

I'm not entirely sure this is different than "security by contract", except the contracts get bigger and have more technology around them?

I think the OP's point here was that if it's a PR and it's ignored: you spent a bunch of time writing a PR (which may or may not have been valuable to you, e.g. if you maintain a fork now). On the other hand, if it was an esoteric contribution process, you spent a lot of time figuring out how to get the patch in there, but that obviously has 0 value outside contributing within that particular open source project.

I agree, and I also share your experience (guess I was a bit earlier with PHP).

I think what's left out though is that this is the experience of those who are really interested and for whom "it's not satisfying" to stay there.

As tech has turned into a money-maker, people aren't doing it for the satisfaction, they are doing it for the money. That appears to cause more corner cutting and less learning what's underneath instead of just doing the quickest fix that SO/LLM/whatever gives you.

Fun fact: in Gilbertese (the language of Kiribati), an "s" sound is written "ti". So Kiritimati is pronounced Kirismas (close to "Christmas").

On my journey there I met a fellow called "Simeon" and people would call him "Tim"...

A lot of folks are saying big ships are outdated. Keep in mind that war is 80% logistics: and if you are going to engage an enemy far away from your landmass (or project power for that matter), you need huge capacity to move materiel to said location, and that normally means ships.

An interesting thing to look at is something called the "Fully Burdened Cost of Fuel": for every gallon that the US delivers to a Forward Operating Base, they spend something like 6-20 gal getting it there.

The point is that you need to move insane amounts of stuff to fight a war effectively. The actual fighting is just the tip of an iceberg of logistics.

I guess I was responding to this:

> everyone can sell it to make a living just doing whatever they are doing everyday

I'm sure the ad networks do a lot more than use high precision variables for soft-linking.

These are professional networks with a ton of capital thrown behind them. They have pretty decent algorithms, heuristics, etc; and you don't make money (compared to the other data correlation teams) if you do simple dumb stuff. I'm certain they take into account those trying to be privacy-conscious, if only to increase their match rates to be competitive.

You will never generate enough money from information about your consumption to fund your consumption. Obviously there's other data, but you get the point.