Interesting. While I am unclear if Jev can indeed be a standalone reviewer because it cannot generate conversational text or free-form comments. Maybe something like this - https://github.com/devagrawal09/jev-review
This sparked an idea for me to use Jev in my recently launched Panel Review tool that reviews the agent's riskiest decisions using a multiple models that argue and come to a consensus. see more - https://truverif.ai/panel-review. In order to determine risk, we use a text based classifier which I think could be replaced by Jev. Will still have to evaluate the privacy and cost considerations.
This sparked an idea for me to use Jev in my recently launched Panel Review tool that reviews the agent's riskiest decisions using a multiple models that argue and come to a consensus. see more - https://truverif.ai/panel-review. In order to determine risk, we use a text based classifier which I think could be replaced by Jev. Will still have to evaluate the privacy and cost considerations.