iblaine

Joined 14 years ago

Karma

716

Submissions

409

Member since

May 6

Data Engineer doing Data Engineer things www.iblaine.com

View on Hacker News

Recent submissions

Comment · 3 months ago

Is the before/after backwards?

Comment · 4 months ago

https://docdiagram.com - A tool for creating technical diagrams. Basically an upgrade from mermaid. Load it into your MCP, prompt it, you'll get a clean diagram binary file in svg/png/etc.

https://anomalyarmor.ai/ - A tool for managing data observability and data anomalies.

Used daily by customers but also for my own work. These tools fill a gap that helps me get sh*t done.

Comment · 6 months ago

AnomalyArmor (http://anomalyarmor.ai) is a data observability platform. I got tired of being priced out of existing tools and hand-configuring per-table thresholds for every new dashboard. An AI agent sets up schema-drift, freshness, and row-count monitoring on Snowflake/Databricks in minutes, and you can ask natural-language questions when something breaks.

$5/table, about half what incumbents charge. Happy to trade a 30-day Professional trial code for honest feedback. Reply here or [email protected].

Comment · 7 months ago

FastMCP is great and this post is overdue. What did FastMCP solve? Lots of code reduction, reduced complexity and the ability to streamline auth. Offloading the auth was a huge benefit. With FastMCP I could replace all my custom JWT validation and get an auth workflow with fewer steps.

Comment · 8 months ago

Boggles my mind that this is actually a thing that still needs to be solved. Just remote into your computer (I prefer TeamViewer). That is it. One step.

Comment · 9 months ago

I had a bad experience with greptile due to what seemed to be excessive noise and nit comments. I have been using cursorbot for a year and really like it.

Comment · 1 year ago

Remind me in 5 years. AI tools don’t hide the fact that the output needs to improve. Calling out the obvious problems is a lazy take.

Comment · 1 year ago

This is common. Big company buys smaller company. Smaller company execs stay on and establish the idea of independence. Eventually smaller company execs move on and Big company fills the ranks with their employees. Nothing sinister. Just how it goes.

Comment · 1 year ago

Having been aquihired three times by FAANG+, the biggest take away is have accelerated vesting. To do that you got be lucky or in the C-suite. Being bought out usually sounds better then reality for everyone but a few that get that accelerated vesting clause.

Comment · 2 years ago

Is there a difference between implicit and explicit joins? No, but use an explain plan to be sure.

(Saved you a click)

Comment · 2 years ago

An IRC bot that would kindly insult project managers should they join our engineering chat channel while doing a deployment.

Comment · 2 years ago

The correct answer is I don’t like makefiles when they are abused. They have no state yet people try use them as such and create pain for others.

Comment · 2 years ago

I used to be bullish on creating ERDs, often using them as an onboarding exercise, even for databases with 100+ tables. However, comprehensive ERDs are becoming rare, and that's okay. Their value is short-lived due to the high cost of maintenance. While polished ERDs can be nice to have, they aren't essential.

For creating ERDs as code, tools like dbdiagram.io and eraser.io are popular options. ERWin is the original tool for UML/ERD diagrams, but it's expensive.

Comment · 2 years ago

Looking at this reminds me of Apache Pig. That’s not a compliment.

Comment · 2 years ago

Low code ETL tools (informatica, Appworx, talend, pentaho, ssis) were the original services for ELT/ETL. A lot of progress was made to go towards ETL-as-code starting with Airflow/Luigi. Going back to low code seems backwards as this point.

(I have used all of the above tools in my 15+ yr career. Code as ETL was a huge industry shift)