Comment by yellowapple

Highly-structured outputs (like what you'd need for tool calls) seems like it'd be easier to put out than arbitrary text, no? At the very least, even something like BERT could make the decision of “Would any of my available tools be useful here?” and delegate to some deeper-thinking model to structure that tool call.