In case this anecdote is not made up, I would implore you or your friend be a bit more subtle at tokenmaxing (ugh). At $JOB, I'm under the same mandate, and it turns out that every prompt is logged and aggregated. When someone else at $JOB asked the team PM who's in charge of the logging, s/he replied that the log is only used to correlate with commits, and nothing else, trust us (wink). I doubt this is unique to my $JOB.
Therefore, sigh burn those tokens, but make sure your prompts are at least superficially defensible, in the unlikely event that you get audited. Use multiple models for the same prompt / task, for instance. It's well know that LLMs are prone hallucinations, so it's only prudent to double / triple cross-check the results with multiple models.
Therefore, sigh burn those tokens, but make sure your prompts are at least superficially defensible, in the unlikely event that you get audited. Use multiple models for the same prompt / task, for instance. It's well know that LLMs are prone hallucinations, so it's only prudent to double / triple cross-check the results with multiple models.