Yes, we default conservatively, when in doubt, escalate.
A few specifics: Uncertain validation: We combine multiple signals (confidence scores, semantic similarity, format checks...). If any signal is borderline, we escalate. Better to overpay occasionally than return a bad response.
Wrong domain detection: The domain classifier isn't a gate, it selects which validator to apply. If the validator then fails, it escalates regardless. So a misclassified query still gets caught at the validation layer.
False-negative rates (good responses wrongly escalated): ~7-10% at the beginning, depending on domain. We're okay with this, it means slightly higher cost but never compromised quality. The self-learning engine tightens this over time as it sees your actual traffic patterns.
Wrong domain detection: The domain classifier isn't a gate, it selects which validator to apply. If the validator then fails, it escalates regardless. So a misclassified query still gets caught at the validation layer.
False-negative rates (good responses wrongly escalated): ~7-10% at the beginning, depending on domain. We're okay with this, it means slightly higher cost but never compromised quality. The self-learning engine tightens this over time as it sees your actual traffic patterns.