Microsoft really put this notion under a spotlight with how they deal with LLMs in VSCode Copilot. The LLMs are just a drop-down menu that you can switch between at any moment, on a whim. They all plug into the same toolchains and are essentially generic commodities. They have slightly different prices for usage but that's about it, their outputs aren't wildly different. On topic for this post: it's very telling that Grok models aren't available in Copilot and nobody cares.
I think this arrangement is probably the future of LLM usage, and it does not bode well for everyone betting the farm that their model will be special.
I think this arrangement is probably the future of LLM usage, and it does not bode well for everyone betting the farm that their model will be special.