Comment by lsaferite

That's exactly what Anthropic was doing for a while.

https://www.anthropic.com/engineering/advanced-tool-use