tepmoc
Joined 10 years ago
Joined 10 years ago
During my evals on my own 3 agents that review in parallel they are much more cost efficient and cover 75% issues. Even on model like haiku it’s better score than default. Multiple passes or raising effort will cover 90+. And this was tested on large diff, about 3500 LoC changes
Because even if you use PreToolUse hook and don't bounce it, it will never work since skill text is injected when along with text that already perpared to it need to be edited.
And ban came after 6-8 hours of last session. My guess they didn’t like that I asked to verify RCE opus found, so he made workable exploit.
Everything else similar to your workflow, no token maxing and etc.
Documentation is first part people see when presented. I personally hate AI written text even though I do agentic engineering a lot as well. Any user facing documentation must be reviewed, if you snoozy by reading it - remove or rewrite.
I do not care about paragraph long comments in code, because I’m not gonna read them, but I still follow my internal guideline and cut all this verbosity to level where it readable using hooks and skills.
So basicly like you said if you care about product do not add placeholders. It’s take away first impression.
So many don’t even bother to tide-up fold their commits into single logical change, consider how many commit agent doing, seems logical to have folded commit history when you open PR.
Default commit and PR body text is word salad didn’t seems to bothered these people. Because if it did they already had hooks and skills to make it look tidy and lack of any AI attribution inserted.
I don’t even consider myself developer more like really weak devops guy, but I was already doing all of that.
I had to create hooks that invoke skills when pushing new commit and open PR body text.
At least this my discovery when I did evals on my reviewers skills. 10k LOC is high end for high effort or around 150k context using opus. You can push towards 15k but that’s on max effort with about 400-500k ctx.
Fast models like haiku do not even need 1M ctx in my view