For anyone interested in a GUI around Jev I built Decision Studio for experimenting with it in our self-hosted OSS llms.py [1]
You can define tasks like sentiment analysis, support triage, or claim support, tweak the questions and criteria, and inspect the answers and probability distributions. You can also import existing recipes, save examples, and share recipes with recorded results.
You can define tasks like sentiment analysis, support triage, or claim support, tweak the questions and criteria, and inspect the answers and probability distributions. You can also import existing recipes, save examples, and share recipes with recorded results.
An OpenRouter API key is required to use Jev.
[1] https://llmspy.org/docs/features/decision-studio