Hi! I forked this project from https://github.com/udaysagar2177/apache-iceberg-fileio in order to make it delegate between database and object store for data/metadata, as well as use reflection for use within other query engines outside of the java api.
While this isn't as good of a spec for database-metadata as something like ducklake would be, there are still many intrinsic benefits to avoiding object store for these many small writes.
While this isn't as good of a spec for database-metadata as something like ducklake would be, there are still many intrinsic benefits to avoiding object store for these many small writes.
See the repo: https://github.com/jordepic/icebase