1-year part-time experiment: can you build a large project with AI writing the code and AI plus deterministic tools verifying/guiding/enforcing it for structural and behavior consistency, without a human reading the code?
I'm building a polyglot web framework in 15 languages, with C# and Lean4 as the reference implementations. Structural and behavioral audits using deterministic tools check that every port stays consistent with the reference. It's about 1.8M lines now. I have not reviewed the code/neither have i verified the behavior tests except at the time of giving requirement and never seen some of the language code at all.
The question is how far can we produce "working code → correct code [Possible] → good code [Unknown]" with deterministic audits correcting structure, ai mistakes and behavior validation.
So far the quality looks acceptable with lots of correction of AI output done without looking, but it isn't fully verified.
I'm building a polyglot web framework in 15 languages, with C# and Lean4 as the reference implementations. Structural and behavioral audits using deterministic tools check that every port stays consistent with the reference. It's about 1.8M lines now. I have not reviewed the code/neither have i verified the behavior tests except at the time of giving requirement and never seen some of the language code at all.
The question is how far can we produce "working code → correct code [Possible] → good code [Unknown]" with deterministic audits correcting structure, ai mistakes and behavior validation.
So far the quality looks acceptable with lots of correction of AI output done without looking, but it isn't fully verified.
Line counts per language, with changes since August: https://claude.ai/artifact/5f1m1pTM7tZ4boQzwsoAG7