Nothing wrong with this question. I do not have any experience with Spark, but I guess Capillaries belongs to the same or similar ecosystem. My understanding is that Spark is way more generic framework that revolves around DAG-defined workflow and map/reduce-style functionality.
Capillaries is about:
- taking a very structured, stage-by-stage, approach to batch data processing with the possibility to control the results of a specific stage (although some kind of workflow DAG is there as well);
- executing a SQL-style aggregation and denormalization on data in Cassandra;
- executing workflows without actually writing code (besides one-liner Go expressions and Python math formulas when needed).
Sorry if I am missing the point with Spark, as I said - I never worked with it.
Capillaries is about:
- taking a very structured, stage-by-stage, approach to batch data processing with the possibility to control the results of a specific stage (although some kind of workflow DAG is there as well); - executing a SQL-style aggregation and denormalization on data in Cassandra; - executing workflows without actually writing code (besides one-liner Go expressions and Python math formulas when needed).
Sorry if I am missing the point with Spark, as I said - I never worked with it.