pjot

I don’t think it’s necessarily the use case changed but maybe the constraints. Streaming directly to Clickhouse is a great solution. Recent approaches I’ve seen though buffer data as parquet in object storage first, and read data from there. Im not sure if CH would be the preference

Thought this was the ascii Star Wars in your terminal à la

  telnet towel.blinkenlights.nl

1008 pages, wow!

It also made a really satisfying “boyoyoyinnng” sound

Will need to degauss after this

Where do you get this free beer?

I used to love watching the “unlimited” storage counter increase as each second went by

I wonder how this would work in trying to parallelize the worker threads (multiple duckdb instances) coordinating them via Quack.

Ducks all the way down!

One step further are those who want to point an llm directly at the data warehouse to get the data needed to run predictions

  > created bunch of fake spam pages and trying to mine crypto

Pages like GitHub pages? We’re repos being created in your account? Curious how you discovered that your tokens were pwned

After years of using orchestration tools like airflow and dagster so many lightbulbs have just lit up in my head.

I wish documentation for tools would explain their abstractions concepts in terms of its primitives.

Great post, thanks!

  > The Chinese are a decade ahead of the west when it comes to building cars.

Is this true? From years of watching Top Gear any Chinese car that was tested was laughably bad.