andrea_s
Joined 12 years ago
Joined 12 years ago
And they were not the only ones: https://en.wikipedia.org/wiki/Operation_Unthinkable
edit: nevermind, it is available again - weird
Now of course Spark makes up for it with its great flexibility and scalability, but I do not really see the two technologies as competing ones.
This even without getting into the other parts of the data model (insert, update, delete) that do not exist in Spark (or "kind of" exist), by design.
My assumption is that it works on metadata coming from a relational schema with a rule parser on top.
Honestly I don't see how it would work well enough if it was based on NLP of unstructured data.
I do believe it is a valuable addition to the GA enterprise tier (especially for customers savvy enough to use BigQuery too), but at the moment I don't quite see it as a serious competitor to other off-the-shelf BI tools - would be very happy to be proved wrong in a few months, though.
It would be interesting to see how much the performances improve once you use cstore_fdw (especially since 1M records is quite small when talking about OLAP workloads).
disclaimer: I've never used cstore_fdw, but I have evaluated a number of columnar databases in the past.
There, I've saved you from reading the article.