mmis1000
Joined 8 years ago
Joined 8 years ago
Your question is something like
anwser only a,b,c,d for following question a. b. c. d....
the model output possibility of next character a: 0.8 b: 0.7 c: 0.3 f: 0.2 d: 0.1
If the list contains option you did not provide. The model is confused anyway, it don't matter if you use grammer to filter out the bad option or not, the answer is screwed already.
It does not change potential distribution in any means. It DROPS part of answer model returned directly.
The text generation model go wild because model relies on previous section it answered to continue later section. And because now it contain item model have no idea, it is completely screwed.
In the case you only require model to answer one of a,b,c,d and don't care about later segment at all. It don't really matter.
in worst case you just install the old rule back if it fuck up, no really damage can happen.
https://developer.mozilla.org/zh-CN/docs/Web/API/Window/scre...
However it's less willing to obey your instruction so it's less usable for general runtine flows.