atwebb
Joined 19 years ago
Joined 19 years ago
https://docs.aws.amazon.com/redshift/latest/dg/querying-iceb...
Databricks (with Delta as the underpinning) seems to have lead the charge of lakehouse meaning, your data lake+file formats/helpers+compute==data lake+datawarehouse==lakehouse.
The latter seems to be the prevailing definition today with the former aging in place.
If asked people would say "I need to always be up" until they see the costs associated with it, then being out for a few hours a year tends to be ok.
Is that a differentiator? I'm unfamiliar with Snowpark's actual implementation but know SQL Server introduced Python/R in engine in 2016? something like that.
https://aws.amazon.com/about-aws/whats-new/2023/04/aws-lambd...
I can't tell if your disclaimer covers it but, yes, there are lots of bad queries that take a little bit of a re-write and run significantly faster. Generally it is someone taking a procedural vs set based approach or including things they don't need to try and help (adding an index to a temp table when it is only used once and going to be full scanned anyways). That's outside the general data typing/generally missing indexes.