afshinmeh
Joined 13 years ago
Karma
4,379
Submissions
811
Member since
Jan 31
afshin.io
View on Hacker NewsJoined 13 years ago
> As of this writing (2018-05-29) the only other recommended storage formats for datasets are XML, JSON, and CSV.
That said, using LakeFS is probably a better long term solution and I like this approach.
I'm mainly focusing on the portability aspect of it (e.g. use TS/Python/etc. to define the workflow/steps or just simple a simple YAML file).