Comment

Comment by mindcrime

Twitter, LinkedIn and Facebook all make some bits and pieces of their system available as open-source. You might particularly want to look at Twitter's FlockDB[1], LinkedIn's Kafka[2], and/or Facebook's Scribe[3].

[1]: https://github.com/twitter/flockdb

[2]: http://sna-projects.com/kafka/

[3]: https://github.com/facebook/scribe

FlockDB is designed to deal with the "social graph" connection stuff (who follows who, etc.) and is optimized for that sort of thing. Kafka and Scribe are more about delivering message widely. Poke around, look at their code, chase down and associated papers, and you should be able to sort out an approach... even if you don't adopt any of those codebases directly. FWIW, I'm looking at integrating FlockDB for some stuff I'm working on, but I haven't gotten very far down that path yet, so I don't have a lot more to offer than this.

parent mindcrime 15 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton