dm03514
Joined 14 years ago
Karma
766
Submissions
272
Member since
Mar 1
https://turbolytics.io
View on Hacker NewsRecent submissions
Comment · 3 days ago
I'm happy to sit down 1:1 and answer questions or get you onboarded!
Comment · 24 days ago
Hi Everyone! (I wrote this article)
I've been working in data space for ~7 years now. I drank the ELT koolaid and then painful learned about its inefficiencies. I'm trying to build tools that take an SRE/DevOps approach to data infrastructure!
I'm building a pipeline tool SQLFlow that aims to enable DevOps for data:
- Configuration Driven - CI Test framework integrated - First class metrics and monitoring
https://github.com/turbolytics/sql-flow
I wrote about some of these while launching SQLFlow on the render platform.
I'm happy to answer any questions or just talk modern data!
Thank you!
-----
I'm trying to build a whole ecosystem. SQLFlow is the stateful stream processor.
dbhealth is a way to monitor postgres and table freshness and schema changes.
control is a way to monitor both of these :)
Comment · 1 month ago
Thank you, fixed:
https://github.com/turbolytics/sql-flow/commit/e7cc28b7bdd2f...
docs are updated:
Comment · 1 month ago
yes! And I appreciate you calling it out, I'll choose a different name for it. It's just a token like posthog or google analytics issues customer-facing tokens. You are welcome to hit the API directly using it. What is this type of token called (one that identifies a JS client)?
Comment · 2 months ago
<3 duckdb run realtime analytics pipeline using a (moderately popular) stream processing engine I built on top of DuckDB. Looking forward to what duckdb provides in terms of perf out of the box!
https://github.com/turbolytics/sql-flow
DuckDB has been a fantastic engine to build on (in python), and processes thousands of events per second, day in an day out, without issue
Comment · 7 months ago
Working on chain of custody for financial transactions!
Our first offering is OrderProof which records Shopify transaction evidence and generates PDF to help merchants streamline chargeback disputes.
https://turboops.io/products/orderproof
----
more about the problem here:
https://www.linkedin.com/pulse/you-losing-shopify-chargeback...