Excellent blog post serie about floating point compression.
All those (lossless+lossy) floating point compression algos including 1D/2D/3D SIMD transpose with integrated xor and zigzag delta are available in the TurboPFor [1] Integer Compession package.
There is a benchmark with the same dataset available in [2] with a comparison to zfp and blosc with the new bytedelta.
TurboPFor functions compress/decompress faster with better compression.
The bytedelta described in the blog is suboptimal and might not work with other datasets.
Download icapp from [3] and make your own tests with your data.
All those (lossless+lossy) floating point compression algos including 1D/2D/3D SIMD transpose with integrated xor and zigzag delta are available in the TurboPFor [1] Integer Compession package.
There is a benchmark with the same dataset available in [2] with a comparison to zfp and blosc with the new bytedelta. TurboPFor functions compress/decompress faster with better compression.
The bytedelta described in the blog is suboptimal and might not work with other datasets.
Download icapp from [3] and make your own tests with your data.
[1] https://github.com/powturbo/TurboPFor-Integer-Compression
[2] https://github.com/powturbo/TurboPFor-Integer-Compression/is...
[3] https://github.com/powturbo/TurboPFor-Integer-Compression/re...