Comment Comment by hasyimibhar It's interesting to watch how different companies that offer both Postgres and warehousing solution under 1 roof approach the same problem:- ClickHouse focuses on traditional CDC (ClickPipes) and just make it blazingly fast- Databricks leans on their unified storage architecture (LTAP) to avoid copying data (though you can argue there is still a copy in the cache)- Snowflake uses a data mirroring CDC as extension so it runs directly on PostgresI'm still waiting for a Postgres provider to just let me mirror data directly to Iceberg, so I can plug in my own stateless query engine. parent hasyimibhar 2 months ago
- ClickHouse focuses on traditional CDC (ClickPipes) and just make it blazingly fast
- Databricks leans on their unified storage architecture (LTAP) to avoid copying data (though you can argue there is still a copy in the cache)
- Snowflake uses a data mirroring CDC as extension so it runs directly on Postgres
I'm still waiting for a Postgres provider to just let me mirror data directly to Iceberg, so I can plug in my own stateless query engine.