Comment by neop1x

There is also a small wrapper over an unmodified llamacpp binary which implements jev decision API on any llamacpp-supported model. It is different than Leya/Kime - raw label softmax, not calibrated! But can sometimes be enough I guess. https://github.com/NakliTechie/llamacpp-jev