Comment Comment by dm03514 pfsh who needs to write data??? ;pIf you have streaming data as a source, I built a side project to write streaming data to s3 in iceberg format:https://sql-flow.com/docs/tutorials/iceberg-sinkhttps://github.com/turbolytics/sql-flowI realize it's not quite what you asked for but wanted to mention it. I'm surprised at lack of native iceberg write support in these tools.Pyiceberg though was quite easy to use, arrow-based API was very helpful as well. parent dm03514 1 year ago
If you have streaming data as a source, I built a side project to write streaming data to s3 in iceberg format:
https://sql-flow.com/docs/tutorials/iceberg-sink
https://github.com/turbolytics/sql-flow
I realize it's not quite what you asked for but wanted to mention it. I'm surprised at lack of native iceberg write support in these tools.
Pyiceberg though was quite easy to use, arrow-based API was very helpful as well.