jtbetz22

Joined 4 years ago

Karma
99
Submissions
42
Member since
Nov 13
Currently trying to reimagine how we improve code quality in the agentic area. http://getcaliper.dev
View on Hacker News

Recent submissions

Comment · 1 month ago
The $500M is part of a larger $3B gift that will also start a CMU campus in Miami, FL. The total gift is the largest individual donation to a US university in history.
Comment · 1 month ago
I suspect they are fielding complaints that autonomous vehicles increase road traffic, so they want to show that they are encouraging the use of public transit. Uber and Lyft have long been blamed for an increase in overall traffic.
Comment · 2 months ago
I periodically go through the big box of cables and pull out anything that I don't expect to ever need again.

I put those in another box, seal it completely, and write a message on the outside along the lines of "presumed useless - Sep 2016".

If I come across that box in, say, September 2026, I feel entirely comfortable tossing the whole thing.

Comment · 6 months ago
I'm continuing to focus on ways to set strong code quality guardrails in an era where most code is not handwritten.

The result is http://getcaliper.dev.

It has a number of mechanisms that help substantially:

1. It can extract deterministic quality checks from your CLAUDE.md text; these checks then get executed after every agent turn.

2. It performs a lightweight ai-powered review at every commit; feedback goes directly to the agent, which can then make corrections.

3. It performs a more 'traditional' deep AI review at merge, or on-demand.

Free to use, just bring your own API key. Any and all feedback is welcome!

Comment · 6 months ago
Comment · 7 months ago
I believe that AI-powered software development means we need to fundamentally rethink how we preserve code quality.

Model output volumes mean that code review only as a final check before merge is way too late, and far too burdensome. Using AI to review AI-generated code is a band-aid, but not a cure.

That's why I built Caliper (http://getcaliper.dev). It's a system that institutes multiple layers of code quality checks throughout the dev cycle. The lightest-weight checks get executed after every agent turn, and then increasingly more complex checks get run pre-commit and pre-merge.

Early users love it, and the data demonstrates the need - 40% of agent turns produce code that violates a project's own conventions (as defined in CLAUDE.md). Caliper catches those violations immediately and gets the model to make corrections before small issues become costly to unwind.

Still very early, and all feedback is welcome! http://getcaliper.dev

Comment · 7 months ago
Comment · 7 months ago
> So even when you have a nicely structured commit history, you end up realizing that some things need to be changed and start appending a bunch of "fix" and "actual fix" commits at the end.

I have found that this no longer needs to be an issue with agentic coding tools.

Once I am happy with the end state of a branch, I tell Claude to rebuild the change from scratch as a set of atomic incremental commits. It adds about 2 minutes to the dev process, but creates a pr that is infinitely easier to review.

The overall thrust of the article is great, though. The tooling around prs needs a ton of attention.

Comment · 7 months ago
Comment · 7 months ago
This is really cool.

In general I think there has been (a) too little utilization of the hooks provided by agents for deterministic checks and follow-ups to agentic coding, and (b) too little investment in creating re-usable org-wide monitoring controls and reporting on convention enforcement.

Oculi looks like a strong advance on both fronts.

Comment · 7 months ago
I find it is now 1000x more effective to draft documents in collaboration with Claude, working with a markdown file as the output format.

However, git doesn't work in my team as a document collaboration mechanism - the commenting and discussion on a file has so much more friction that Google Docs or Notion.

What I've ended up on is a workflow where I iterate on the doc until I am satisfied, then export it to notion (via MCP) and publish that for feedback. Once there is consensus on the notion doc, that becomes the artifact of record.

It's a suboptimal solution, though - claude makes a number of poor design choices when exporting .md -> notion.

Comment · 7 months ago
Comment · 7 months ago
Interesting. I don't know if people are trusting AI-generated code too much, but AI is generating way more code than humans can review, and the 'looks fine' bar is what the AI gets held to.

I strongly agree with you that the solution likely involves pushing the correction mechanism much closer to the point of code generation. You want to put the AI back on track as soon as it starts to stray, you can't let it build a lot on top of a mistake.

My own attempt at resolving this involves running a set of deterministic checks on agent-generated code at the end of every agent turn, along with a lightweight AI-powered review on every commit, and deep AI review on PRs before merge. I am pretty happy with the results so far.

Comment · 7 months ago
At my company, we ask everyone in the hiring process about how they have used any kind of agentic coding tools.

We're not concerned about hiring for the 'skill' of using these things, but more as a culture check - we are a very AI-forward company, and we are looking for people who are excited to incorporate AI into their workflow. The best evidence for such excitement is when they have already adopted these tools.

Among the team, the expectation is that most code is being produced with AI, but there is no micromanager checking how much everyone is using the AI coding tools.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton