aratno
Joined 11 years ago
Karma
459
Submissions
78
Member since
Jul 7
Recent submissions
Comment · 1 year ago
Looks like this is slightly modified by the uploader: p94 says “Weaponize the cloud” with the Antimetal logo
Comment · 5 years ago
Have you used osquery? Seems like a good chunk of what you’re looking for!
Comment · 5 years ago
Immediately searched for “Nagle”, “TCP”, etc but was surprised to see this is something else! Not the typical TCP_NODELAY issue.
Comment · 6 years ago
I don’t think this is a fair reason to write the tool off. They support Homebrew, and I’m sure will add other install methods in the future. Piping to bash is no worse than clicking “yes” on every step of an install wizard.
Comment · 6 years ago
Using something like io-ts gives you the benefits of static types and runtime types. JSON Schema typically just provides runtime guarantees but doesn't come with the same development experience. I've been very happy with io-ts so far.
Comment · 6 years ago
ML-assisted query optimization is super interesting to me (I've had to fight the uphill battle against anomalies in Postgres stats and estimations[1]), but I'd also love to see more optimization and auto-tuning across the "stack":
- Use column-oriented storage for columns that are frequently scanned in analytical queries
- Automated index management, based on user-provided boundaries for write throughput, disk footprint, query latency
- Calibrated optimism for heap updates. AFAIK, current DBs are either optimistic (assume transactions are more likely to commit than rollback) and update the heap in-place, and write the old value elsewhere in case of rollback, or pessimistically write all updates in new, versioned tuples and let MVCC (and garbage collection) handle the rest. Would be interesting to see the performance improvement that could come from modeling commit / rollback outcomes and optimizing accordingly.
- Using variable-sized pages to reduce overhead for older pages, as a sort of light cold storage
Anyone know of any DBs that automatically tune these aspects?
Comment · 6 years ago
Terraform does let you destroy resources: https://www.terraform.io/docs/commands/destroy.html
Comment · 6 years ago
I see some references to Presto, but does anyone know what this engine is based on? Seems vaguely similar to Druid but it's hard to tell.
Comment · 6 years ago
Nope, they've been sharing their research more widely in the last few years. Here's an example from 2018, in a different area of research: https://www.vldb.org/pvldb/vol11/p540-shraer.pdf