antruok

I wonder why Singlestore has been so unpopular (at least I never hear about it). Quick guess is that HTAP itself isn’t a significant feature requirement, maybe just a cherry on top of other major db features.

Enterpise also often wants a full data platform (like Databricks), not a plain data warehouse.

In my experience, one factor is databricks releasing features fast but unpolished.

I like how they’re innovating, but it can be rough around the edges sometimes.

In addition to the AI use cases, sometimes you wanna share the data warehouse data in oltp way for fast lookups and high concurrency. Not sure whether Neon will do that but I hope so.

One example from Snowflake is hybrid tables which adds rowstore next to columnar.

OLAP + OLTP = HTAP

the new cost-optimized mode is very promising, though

The query structure does look nice indeed! The usage of the pipe character feels odd but I suppose there are benefits in the end

So apparently the check_cols parameter didn't help either?

I'm trying to learn about the critical pain points of dbt, and this case seems interesting.

The snapshots feature should handle the slowly changing dimensions. But are you saying it's not flexible enough for certain edge cases?

It's OK, but I noticed that my colleagues started cursing a lot more after we started using it. It's still a bit rough around the edges, and there are interesting pitfalls you just learn after failing.

We mainly use the K8sOperator, and the logic is mainly inside independent containers. Therefore our development and testing is not so tightly coupled to Python or Airflow.

Same here, too much work just for simple charts

AHK is good for hotkeys and keyboard/mouse overrides. And maybe some mini window automation.

If the logic grows and automation becomes complex, AutoIt is more suitable.

Airflow is the king of workflow engines, but in my short experience, it seems unpolished.

Does anyone have experience with Digdag?

The workflow DSL looks so nice.