Considering Jev is named after Jevon's Paradox (making things cheaper increases spending) I'm willing to bet that it's the former. Smaller model, possibly an inference pipeline optimized for a Jev-like workload (large shared context that is used for multiple questions in parallel)
And while Jev has a lot of latency, that latency stays very flat with larger inputs. So it's probably related to their inference pipeline, not model size
And while Jev has a lot of latency, that latency stays very flat with larger inputs. So it's probably related to their inference pipeline, not model size