nicoritschel
Joined 14 years ago
Joined 14 years ago
Good idea for an extension, especially with the new PEG parser.
We used to use Metabase but the cloud / self hosted divide was too much fiddling, along with the expression language.
I built a DuckDB extension so you can connect via Postgres wire protocol, or Arrow flight. DuckDB also has its own Quack protocol, but client support for Quack is very limited right now, whereas many data tools support Postgres wire protocol or ADBC (which you can use with Arrow Flight).
Fast forward to late 2026 and I couldn't imagine living without my tens of GBs of agent sessions fully indexed & ready to search. Memex allows you to search agent sessions cross-harness and even fork a session to another harness. Memex offers federated search across machines over SSH too and sync (into your own object storage) is coming soon. There's a CLI, a TUI, native Mac app, QT app, and an MCP server to use from web AI chat (I use Memex in ChatGPT with the "Pro" models quite regularly to plan).
Stop copy & pasting details between sessions or struggling to find an old agent session to resume!
Traditional observability is ill-suited for observability around business events. What if you forget to instrument a counter or gauge for something? In my experience it's far easier to log wide events with as much context as possible instead of agonizing over anticipating the dimensionality of metrics upfront (you're going to miss something).
Yes this was also my experience working at a large tech co. I work in fintech now and data volumes are low enough to maintain 2-3 minute up to a few hour data freshness.
The next step in this journey is Iceberg (and a proper incremental pipeline), which can also be read directly in the browser via WASM either via DuckDB or without. This is from the same author as the parquet library mentioned in the OP https://github.com/hyparam/icebird
Thanks Apple.
I built it with this exact ethos, a curated set of "extended" functionality instead of a plugin system.
What plugins do you rely on in Obsidian?