Comment Comment by gavinray It's really cool to see that other people run into the same issues and arrive at the same conclusions/solution.At $DAYJOB, we have an LLM-based tool and this issue of "how do we avoid burning tokens solving the same problems over again" was an early obstacleWe wound up building a very similar thing to what you call "tools" (we named them "Saved Programs").There's a wiki the LLM searches before solving a problem, that links saved programs for past actions to their content entry.If it finds one, it'll re-use it, otherwise it'll generate a program and offer to save it, if you think it'll be common enough. parent gavinray 6 months ago
At $DAYJOB, we have an LLM-based tool and this issue of "how do we avoid burning tokens solving the same problems over again" was an early obstacle
We wound up building a very similar thing to what you call "tools" (we named them "Saved Programs").
There's a wiki the LLM searches before solving a problem, that links saved programs for past actions to their content entry.
If it finds one, it'll re-use it, otherwise it'll generate a program and offer to save it, if you think it'll be common enough.