Comment Comment by newhouseb Right, there are many folks (dozens of us!) yelling about logit processors and building them into various frameworks.The mostly widely accessible form of this is probably BNF grammar biasing in llama.cpp: https://github.com/ggerganov/llama.cpp/blob/master/grammars/... parent newhouseb 3 years ago
The mostly widely accessible form of this is probably BNF grammar biasing in llama.cpp: https://github.com/ggerganov/llama.cpp/blob/master/grammars/...