c4pt0r

100 tok/s on a 4090 could unlock entirely new use cases. What becomes possible when local inference is this fast?

Local open weight models will definitely be a future trend. Imagine if an Opus-level model could run locally: many more latent use cases would likely emerge, since Opus is priced so high. Perhaps the future will be a multi-model architecture, where frontier models handle planning and local models carry out the concrete execution.

Hi HN, Pie author here

I’ve been building pie, an open-source coding agent written in Rust. The initial reason was that I had some proactive, long-term automated tasks to run on a local DS v4 model. Therefore, I needed a customizable agent runtime to support these custom tasks, such as triggers, to perform some simple automation, Over time, the project gradually became more and more usable, so I thought I might as well turn it into a proper project. Of course, most of the code in this project was written by AI. If you’re sensitive to AI-generated code or AI coding, feel free to simply ignore it.

Pie runs inside your local project directory, can inspect/edit files, run shell commands, keep resumable sessions, and use different model providers, including local OpenAI-compatible servers.

The goal is not just to build another chat UI for coding, but a local agent runtime for developer workflows: slash commands, session history, skills, MCP tools, cron/triggers, and a small hub so agents running on different machines can send messages to each other.

A few things I’ve been focusing on recently:

- local/session-first workflows: resume sessions, search history, save transcripts

- model flexibility: Anthropic/OpenAI/etc., plus local OpenAI-compatible endpoints

- MCP and skills for attaching project-specific tools/instructions

- cron/triggers for lightweight automation inside a coding session

- SSH/headless support for running agents on remote dev boxes

- a web UI that mirrors the terminal runtime rather than replacing it

- an optional hub for agent-to-agent messaging and notifications

Love to hear feedback from you, thank you!

i know they will have alsamixer in this list.

it has nothing to do with TiDB, db9 is built from scratch.A good way to think about it is that db9 is similar to tidb-server, it provides a PostgreSQL wire protocol and SQL layer, while the actual data lives in the underlying KV layer.

yes, it’s quite a journey