It could still trigger a false positive given that for the time being there’s no way to “prove” that the model will reply in any given way. There are some novel ideas but they require access to the raw model. [0] [1]
It can be made to, and I think I stumbled upon a core insight that makes simple format coercion reproducible without fine-tuning or logit shenanigans, so yeah, this allows you to both reduce false positives and constrain failures to false positives or to task boundaries.
There’s also RHLF-derived coercion which is hilarious. [2]
It can be made to, and I think I stumbled upon a core insight that makes simple format coercion reproducible without fine-tuning or logit shenanigans, so yeah, this allows you to both reduce false positives and constrain failures to false positives or to task boundaries.
There’s also RHLF-derived coercion which is hilarious. [2]
[0] https://github.com/1rgs/jsonformer
[1] https://news.ycombinator.com/item?id=35790092
[2] https://twitter.com/goodside/status/1657396491676164096