joelwilsson
Joined 10 years ago
Joined 10 years ago
That could be improved without fixing the whole JVM data ecosystem, but that's mostly up to JVM developers. It's unfortunate if the Spark developers using Arrow aren't contributing in this area (especially since many of them are being paid), but it's all open source and undoubtedly pull requests are welcome.
Congratulations on the 1.0 release, it's only going to keep getting better! Really exciting to be able to share data in-memory across languages.
If you need deletes and transactions, look elsewhere, but Clickhouse seems to be great for what it's been designed for.
If Apache Arrow takes off I hope BigQuery will support it as a data interchange format in the future. Zero-copy is pretty awesome, as are open standards in general. This feature does not exist in BigQuery today (as far as I know - definitely not as discussed in the source).
And the biggest problem for startup founders remains: you're taxed, on leaving the country, on unrealized gains. Being taxed on 5 millions of profit sounds fair, being taxed on 5 millions (or 30 millions) of valuation used for raising capital, in a startup that then fails and is worth nothing after a few years, maybe not so much. Neighboring countries do not have this kind of taxation.