1egg0myegg0
Joined 5 years ago
Karma
170
Submissions
76
Member since
Oct 15
Recent submissions
Comment · 2 months ago
This fall, DuckDB will support larger than memory indexes! I'm really excited about it.
https://duckdb.org/2026/08/17/duckdb-20-highlights#7-storage...
Comment · 2 months ago
Oh, then you might like these DuckDB community extensions that provide stats functions!
https://duckdb.org/community_extensions/extensions/stats_duc...
https://duckdb.org/community_extensions/extensions/stochasti...
Comment · 1 year ago
Whoever gets that magical -2,147,483,648 is going to be really surprised that things keep working
Comment · 1 year ago
We support spatial calculations in the UI, but not spatial visualizations just yet. Thanks for the feedback!
Comment · 1 year ago
Sorry you hit that! This is actually already working on version 1.2.2. Could you install that version? That should get you going for the moment! We will dig into what you ran into.
Comment · 1 year ago
It is already available in the local DuckDB UI! Let us know what you think!
-Customer software engineer at MotherDuck
Comment · 1 year ago
IN list filter predicate pushdown is much improved in DuckDB 1.2, coming in about a week! I am not sure if it applies to Arrow yet or not. Disclaimer: I work at MotherDuck and DuckDB Labs
Comment · 1 year ago
That is very surprising to hear! If you can reproduce it, could you please file a bug report on GitHub? That would be a huge help!!
Comment · 2 years ago
Are we in the Dune timeline?
Comment · 2 years ago
Hello! I would recommend trying out DuckDB's SQLite attach feature! You can read or write data, and even make schema changes, all with DuckDB's engine and syntax. The storage then uses SQLite, which is row oriented!
https://duckdb.org/docs/extensions/sqlite
(I work at MotherDuck and DuckDB Labs)
Comment · 2 years ago
Extension downloads are validated using a signature check to prevent tampering!
(I work for DuckDB Labs and MotherDuck)
Comment · 2 years ago
Howdy! I work at MotherDuck and DuckDB Labs (part time as a blogger). At MotherDuck, we have both client side and server side compute! So the initial reduction from PB/TB to GB/MB can happen server side, and the results can be sliced and diced at top speed in your browser!
Comment · 2 years ago
Howdy! Thanks for your benchmarking!
Your blog does a great job contrasting the two use cases. I don't think too much has changed on your main use case, however here are a few ideas to test out!
DuckDB can read SQLite files now! So if you like DuckDB syntax or query optimization, but want to use the SQLite format / indexes, that may work well.
Since DuckDB is columnar (and compressed), it frequently needs to read a big chunk of rows (~100K) just to get 1 row out and decompressed. Mind trying to store your data uncompressed? Might help in your case! (PRAGMA force_compression='uncompressed')
Comment · 2 years ago
We heard your feedback! Backward compatibility was just implemented! Version 0.9 is actually fully readable by 0.10. With version 1.0 coming in a few months, this will be readable for several years' worth of version updates.