pulse7

Educate me: how to create a program in Goose which reads a JSON structure, prints it out and finishes. How is memory for JSON allocated on stack? It can be from 1K to 1M - depending on the file...

Prompt processing on Macs is VERY slow...

I hope we will soon have an open-source project for training such small LLMs where one can just pick the architecture (like Qwen / DeepSeek / etc.), parameter count, dataset, ... and then let it run on a local/rented GPUs...

"code translation in hardware" microcode is called "native"

So it's mostly the "Optionality". Like USB. And yet USB is everywhere...

It there anything similar for RTX 3090 and RTX 4090?

Can you please tell which Gemma 4 variant managed to correctly reason through your private benchmarks? Was is Gemma 4 31B?

What quantizations and context lengths did you use for Gemma 4 and Qwen 3.8 27B?

I am asking because I can't even load Gemma 4 31B on my GPU with any reasonable quantization (even with small context), while I can run Qwen 3.8 27B with large context and good quantization...

It will come... all big hardware players (Intel, AMD, Broadcom) and dozens of startups (Tenstorrent, etc.) are working on it...

Hasn't Docker always been just a thin layer of duct tape over existing solutions?

You cannot wear out an SSD through AI inference alone. LLM weights are only read from the SSD, and read operations do not contribute to SSD wear. SSD wear is primarily caused by write and erase operations.

Those are routers - not general purpose computers.

On the absolute limit of ethics? This is simply not ethical anymore...

The same here! Merged several repos into monorepo are retained full history!

Most probably not optimized yet for this model...