Comment Comment by mritchie712 Very cool!One thing to keep in mind:DuckDB can directly query parquet files (and many other file types[1]), mysql, postgres[0], and SQLite. So if you're in need of something like this, DuckDB on it's own might work for your use case.0 - https://duckdb.org/docs/extensions/postgres1 - https://twitter.com/thisritchie/status/1767922982046015840 parent mritchie712 2 years ago
One thing to keep in mind:
DuckDB can directly query parquet files (and many other file types[1]), mysql, postgres[0], and SQLite. So if you're in need of something like this, DuckDB on it's own might work for your use case.
0 - https://duckdb.org/docs/extensions/postgres
1 - https://twitter.com/thisritchie/status/1767922982046015840