Comment Comment by xwn Static prompts are a downside of using academic research in a tool like this. Two notes:* ineffective prompts come out of garak and new prompts come in to garak, so eval scores always drop over time on a static target* there are more and more dynamic probes - check out eg atkgen and topic probes. expanding these is the current focus parent xwn 1 year ago
* ineffective prompts come out of garak and new prompts come in to garak, so eval scores always drop over time on a static target
* there are more and more dynamic probes - check out eg atkgen and topic probes. expanding these is the current focus