Comment

Comment by gharman

I’ve been doing “marketing” experiments with adjusting MCP descriptions to try to optimize selection of a particular service. Not just maximizing “clicks” but optimizing type 1 and type 2 errors - choose this service when it would fit the task, and move along when it won’t.

What have I found? The frontier models (my main targets) usually don’t search for MCP tools at all from catalogs or even the providers’ own “marketplaces” if you haven’t specifically installed or directed the model to do so. The models have a strong bias towards attempting to DIY a solution instead of searching (for tools).

They will happily search the web for domain-related information. So the answer to the headline question seems to be: nope because the models don’t do that. But it could be if the next generation were tuned differently to have that preference.

parent gharman 20 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton