One thing about LLMs is that they are 6GB+ (and much larger for "smart" ones) just sitting in the background. They suck power and produce heat like nothing else, and they are finicky, especially at smaller sizes.
Running one as a background desktop assistant is whole different animal than calling a Microsoft API.
Running one as a background desktop assistant is whole different animal than calling a Microsoft API.