Discussion

What database would you use to store (min) 10 billion objects?

I'm building something that's going to store 2 billion media objects in the short term, with each object having 10+ related objects on top. Think crawler with some interesting extrapolations/filters/etc applied.

Would want to be able to power multiple views on data, mostly in aggregate form.

This is all greenfield: the data exists but i'm starting from scratch to crawl and reformat it. I'm interested to know how you might consider storing the info?

Thanks :)

63 points imajes 17 years ago 46 comments

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton