Comment

Comment by user5994461

Good read, except the part where the author says there are no existing solutions for processing logs. There are quite a few robust scalable ones.

syslog-ng, logstash or fluentd on the host to collect and aggregate logs. (logstash/fluentd can parse text messages with regex and handle a hundred different things like s3/kafka/http but they are much more resource intensive).

kibana or graylog to centralize logs and search, the storage is elasticsearch.

A simple syslog-ng on the devices could probably do the job. Little known fact about syslog, it can reliably forward messages over TCP, logs are numbered, have retries and syslog-ng can do DNS load balancing.

parent user5994461 6 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton