Hi, I'm Leon one of the cofounders of Galaxy. We just open sourced Filament, our data movement engine.
Its written in Go and Apache 2.0 licensed. We currently support a handful of API connectors, Postgres, MySQL, ClickHouse, Iceberg, and S3.
We benchmarked Filament against a bunch of other open source data movement tools and results + the harness is available at https://github.com/galaxy-io/benchmarks.
This is just our first minor release of Filament and there is a ton to build. We are excited to shape our roadmap around your feedback. If you are willing to give it a try any feedback would be greatly appreciated!
Its written in Go and Apache 2.0 licensed. We currently support a handful of API connectors, Postgres, MySQL, ClickHouse, Iceberg, and S3.
We benchmarked Filament against a bunch of other open source data movement tools and results + the harness is available at https://github.com/galaxy-io/benchmarks.
This is just our first minor release of Filament and there is a ton to build. We are excited to shape our roadmap around your feedback. If you are willing to give it a try any feedback would be greatly appreciated!
Docs at https://filament.getgalaxy.io and a longer blog post on why we built it at https://www.getgalaxy.io/blog/introducing-filament