ixaxaar

I'm running it using a 4090 on using llama.cpp with Q5_K_S and its running at ~33 t/s

For a moment there I read "TC" and was like "the candidate"?!?!

Apparently there's "more to come" and its not a complete retirement.

Well healthcare needs its own DLSS 5!

Okay so regardless of the model, platforms provide attestation from end to end that nothing is being logged from either input or output, including at the firmware and OS level to the extent that the customers have proof of the data never being saved. AFAIK, both GPUs and TPUs support this.

From a third-world perspective, it feels like American politics being injected into the developer domain because of some previous biases that Americans had. Which is sad for a community that claims to be global.

Or maybe he was searching for "structure", the way Grothendieck was - in pure math, in systems biology, in complex networks (e.g. civilizations, culture, occult) and in individual behaviors

I wonder how many of these hype-chasing AI founders are going to take the path of self-enrichment while capitulating their startups when they get exhausted of searching for a moat.

> These are effectively identical to outsourcing your product to someone like Infosys.

But in my experience, the user has to be better than an Infosys employee to know how to convey the task to the LLM and then verify iteratively.

So more like an experienced engg outsourcing work to a service company engg.

Ah so like NIM is a set of microservices on top of various models, and this is another set of microservices using NIM microservices to do large scale OCR?

and that too integrated with prometheus, 160GB VRAM requirement and so on?

Looks like this is targeted for enterprises or maybe governments etc trying to digitalize at scale.

Garbage in garbage out.

Can you shed some more light on this "browning out" phenomenon?

What a sad fucking world. I like what China does in the regard to patents. That is exactly what patents deserve.

Woohoo exactly!