Comment

Comment by khurs

There are self hosted object stores which use the same protocol as S3. One example: https://github.com/minio/minio

Parquet files are smaller than row based storage in a database (but not those databases with focus on strong compression).

And for backup - the files are probably easier to just copy to multiple disks for redundancy, as opposed to database dumps and incremental backups which at the Petabyte scale will be a pain.

parent khurs 4 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton