wr
hn
Top
New
Best
Ask
Show
Jobs
Back
h
hexene
Joined 9 years ago
Karma
10
Submissions
6
Member since
Nov 2
View on Hacker News
Recent submissions
The real cost of TLDs
g
github.com
3
hexene
6 years ago
1
comments
Comment · 7 years ago
If you wanted multiple pull-based consumers for the stream, wouldn't you need a separate SQS queue per consumer, with each queue hooked up to SNS? Perhaps I'm mistaken, but that seems brittle to me. With Kinesis/Kafka, you only need to register a new appName/consumer group on the single queue for fan-out. Plus, both are FIFO by default, at least within a partition.
Comment · 7 years ago
Possibly this:
https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQS...
Comment · 7 years ago
One downside of SQS is that it doesn't support fan-out, for eg. S3->SQS->multiple consumers. The recommendation instead seems to be to first push to SNS, and then hookup SQS/other consumers to it. Kinesis/Kafka would appear to be better suited for this (since they support fan-out like SNS and are pull-based like SQS), but aren't as well supported as SNS/SQS (you can't push S3 events directly to Kinesis for eg.) Can someone from AWS comment on why that is? Also, related: when can we expect GA for Kafka (MSK)?
Comment · 9 years ago
It really depends on the use-case, though I'll concede that docker would've been overkill for the parent based on their comment below.
Comment · 9 years ago
I'm of course not suggesting you switch back to MySQL, but distributing preconfigured MySQL docker images perhaps might've helped with your configuration troubles.