Comment by mritchie712

We (https://www.definite.app/) solved this a bit differently.

We spin up a data lake and pipelines (we support 500+ integrations / connectors) to populate the data lake for you then put DuckDB on top as a single query engine to access all your data.