To me, the weakest link of this whole chain (and a lot of automation chains) is the classifier. Something (probably a Claude model) decides which part is sent to a human reviewer.
How is it calibrated? Do you rank every file in the project by their criticality? Do you train a classifier? Do you base it on some heuristic like number of downstream files affected?
How is it calibrated? Do you rank every file in the project by their criticality? Do you train a classifier? Do you base it on some heuristic like number of downstream files affected?