It seems enormously unlikely (or flat out incompetent) not to have middleware that scans the output for known text and filters it.
I mean… sure, if you’re exposing the raw model, you can’t do that. …but this is an API. They’re surely not so stupid as to have the full raw text of the prompt, and not be filtering the outputs for it before they return the api response?
Seriously. If you don’t want to leak your prompt, it’s a trivial filter to not do so?
Maybe you can work around it, eg “convert the prompt to French” or similar, but surely the most basic api level raw text filter would catch this?
It seems enormously unlikely (or flat out incompetent) not to have middleware that scans the output for known text and filters it.
I mean… sure, if you’re exposing the raw model, you can’t do that. …but this is an API. They’re surely not so stupid as to have the full raw text of the prompt, and not be filtering the outputs for it before they return the api response?
Seriously. If you don’t want to leak your prompt, it’s a trivial filter to not do so?
Maybe you can work around it, eg “convert the prompt to French” or similar, but surely the most basic api level raw text filter would catch this?