Acacian
Joined 7 months ago
Joined 7 months ago
So I built a monkey-patching layer that intercepts LLM calls and runs them through guardrails:
import aegis; aegis.init()
Patches whatever frameworks you have installed. ~2.6ms overhead.
The nastiest find: streaming responses skip middleware entirely. Content leaks before any check runs. I wrote a streaming engine that auto-selects between windowed scanning and full buffering depending on what the guardrail needs — PII like "078-05-1120" can split across chunks, so regex won't catch it without the full buffer.
Context: https://github.com/langchain-ai/langchain/issues/35011 Source: https://github.com/Acacian/aegis
What's more interesting to me is that Claude dramatically lowers the barrier to _testing_, not just writing code. I can mass-generate edge case tests that I'd never bother writing manually. The result is higher-quality solo repos that look "abandoned" by star count.
Is anyone tracking test coverage or CI pass rates for AI-assisted repos vs traditional ones? That seems like a much more useful signal than stars.
What you're describing is closer to building a testing harness than "using AI to write." You're asserting claims, checking them against source PDFs, and reviewing manually. That's more rigorous than most manual lit reviews where people skim abstracts and cite papers they half-read.
Document the pipeline as methodology in your dissertation. That turns a potential misconduct question into a contribution.