lmf4lol
Joined 2 years ago
Joined 2 years ago
For instance, one customer has 15(!) cronjobs. And they all used LLM calls to do stuff. So they ran out of tokens super quick and asked us for help because they didn' tknow what to do. Its not an engineering company, the owner has a sales background. So we went in and wrote scripts for them so that the cron calls don't need to use the LLM anymore.
EDIT: Because someone downstream rightfully asked if we look at user's sandboxes: Yes! IF they ask us. Our users aren't engineers and often get stuck and even the LLM can't figure it out. THEN - AND ONLY THEN - we jack into the sandbox and help them.
I cant ofc be fully sure because i don’t own the chain end 2 end.
Once its gets juicier, we let flash launch specialized subagents with specific models. GLM-5.3 for coding or Kimi K.3 for research and critique.
But as a main driver. I love flash. And it brought our bill down by A LOT :D