Comment by samnji

Nice. Routing is the hard part. Do you have numbers on false accepts vs false escalations? (i.e., how often you keep a bad cheap answer vs unnecessarily jump to the expensive model). Benchmarks are good, but those two rates are what will make or break it in prod.