felixhandte

Joined 12 years ago

Karma
426
Submissions
86
Member since
Apr 8
Software Engineer working on Data Compression at Facebook.

[ my public key: https://keybase.io/felix; my proof: https://keybase.io/felix/sigs/mjJ1GvUGKTRmYImkgCu8Z04zn4AetQ7MsGOGRCSMh-A ]

View on Hacker News

Recent submissions

Comment · 1 year ago
SDDL (and the front-end task of reshaping data in general) is only one component of OpenZL. Once you have the streams, you can do all sorts of transformations to them that Zstd doesn't.
Comment · 1 year ago
The OpenZL core supports arbitrary composition of graphs. So you can do this now via the compressor construction APIs. We just have to figure out how to make it easy to do.
Comment · 1 year ago
Comment · 1 year ago
Comment · 1 year ago
Yes. None of the algorithms under test used any hardware acceleration in the benchmarks we ran.
Comment · 1 year ago
Ooh, thanks for mentioning these! I wasn't aware of the existence of these tools but yes it seems very possible that you could transform these other spec formats into SDDL descriptions. I'll check them out.
Comment · 1 year ago
Yes, definitely! Chunking support is currently in development. Streaming and seeking and so on are features we will certainly pursue as we mature towards an eventual v1.0.0.
Comment · 1 year ago
Thanks @dang!
Comment · 1 year ago
Comment · 1 year ago
Let us know how it goes!

We developed OpenZL initially for our own consumption at Meta. More recently we've been putting a lot of effort into making this a usable tool for people who, you know, didn't develop OpenZL. Your feedback is welcome!

Comment · 1 year ago
Comment · 1 year ago
Comment · 1 year ago

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton