Comment Comment by leobg What’s so difficult about running the user input through a classifier first: “Is this user trying to access your prompt?”I bet you can train a lowly T5 on this.If the answer is yes, don’t even pipe the input to the LLM at all. Just output a hard-coded message.(Or, if you prefer, do pipe it to the LLM, but append a note of warning to it.) parent leobg 3 years ago
I bet you can train a lowly T5 on this.
If the answer is yes, don’t even pipe the input to the LLM at all. Just output a hard-coded message.
(Or, if you prefer, do pipe it to the LLM, but append a note of warning to it.)