jmvldz

The explore step with Codex-5.3-Spark and Opus 4.6 Fast both feel incredible.

I don’t have much in the way of tests right now but I am building with Typescript and Rust so that catches many basic bugs.

I don’t find the issue to be breaking other parts of the app, more-so that new features don’t work as advertised by Claude.

One of my takeaways here is that I should give Claude an integration test harness and tell it that it must finish running that successfully before committing any code.

Interesting. I had not thought about a code review sub agent. I will give that a shot.

Haha fair enough. Fixed!

I'm trying to prototype extremely quickly and I'm working on my project alone so yes, often I accept PRs without looking too closely at the code if my local testing succeeds.

I'm using Typescript and Rust and I think it's critical to use strict typing with LLMs to catch simple bugs.

I've worked at Uber as an infra engineer and at Gem as an engineering manager so I do consider myself an "actual professional developer". The critical bit is the context of the project I'm working on. If I were at a tech company building software, I'd be much more reticent to ship AI generated PRs whole cloth.

I don't have a ton of tests. From what I've seen, Claude will often just update the tests to no-op so tests passing isn't trustworthy.

My workflow is often to plan with ChatGPT and what I was getting at here is ChatGPT can often hallucinate features of 3rd party libraries. I usually dump the plan from ChatGPT straight into Claude Code and only look at the details when I'm testing.

That said, I've become more careful in auditing the plans so I don't run in to issues like this.

Ooh, that's a good title for another post! And yes, I agree with you.

Initially I would barely read any of the code generated and as my project has grown in size, I have approached the limits of that approach.

Often because Claude Code makes very poor architectural choices.

100% yes. QA'ing a bunch of LLM generated code feels like a mental flood. Losing that mental rest is a great way to put it.

"It isn't like programming. It is its own thing."

You articulated what I was wrestling with in the post perfectly.

Ah interesting. I wonder if it's similar with Devin users.

I agree the branching sounds super cool!