sammysidhu
Joined 5 years ago
Karma
14
Submissions
23
Member since
Sep 8
Joined 5 years ago
We expose something called a ScanOperator which allows integration into various catalogs through a thin layer that exposes ScanTasks.
Iceberg's impl: https://github.com/Eventual-Inc/Daft/blob/416009138359a9d410...
We're the people behind Daft (On the front page today!), a distributed dataframe built in Rust. We're VC backed and founded by folks from the self driving industry.
We're looking for developers who want to help build the next generation Spark!